00000001:02000400:1.0F:1789023778.954655:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789023798.094231:0:3518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1789023799.839614:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 519 MB/s 00000001:01000000:3.0:1789023800.089535:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1015 MB/s 00000001:01000000:0.0:1789023800.339283:0:3581:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4639 MB/s 00000020:02000000:3.0:1789023801.259219:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gf941a14 00000400:02000000:1.0:1789023802.214372:0:3625:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.118@tcp [8/256/0/180] 00008000:02000000:2.0F:1789023805.913540:0:3774:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789023870.842954:0:5741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789023885.904179:0:6492:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789023885.904186:0:6492:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789023885.904187:0:6492:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789023885.904343:0:6492:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000073c620b3 00000080:02000400:0.0:1789023885.904353:0:6492:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:0.0:1789023885.931090:0:6492:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789023885.931103:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789023885.931134:0:6492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000036ee37e2) 00000020:00000080:0.0:1789023885.931189:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789023886.037139:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789023886.037285:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789023886.082878:0:6492:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789023886.083203:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789023886.083222:0:6492:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789023886.083237:0:6492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb3134 00000020:01000004:0.0:1789023886.083246:0:6492:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789023886.083252:0:6492:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789023886.083258:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000073c620b3 from MGS 00000020:01000004:0.0:1789023886.083264:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789023886.083276:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008aeafb02) 00000020:00000080:0.0:1789023886.085674:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789023886.085798:0:6492:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073c620b3 from MGS, refs=2 00080000:01000000:0.0:1789023886.085808:0:6492:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789023886.085817:0:6492:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb3142 00000100:00100000:0.0:1789023886.086014:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789023886.086185:0:6492:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789023886.086193:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789023886.095850:0:6492:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789023886.097255:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789023886.100365:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023886.100625:0:6492:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789023886.100636:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789023886.119461:0:6492:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789023886.119489:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789023886.120437:0:6492:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789023886.120448:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789023886.126455:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023886.126464:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023886.126467:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023886.129047:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023886.129056:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023886.129058:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023886.130008:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789023886.136736:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789023886.380360:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2964 MB/s 00000001:01000000:2.0:1789023886.630557:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3007 MB/s 00000001:01000000:2.0:1789023886.881382:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 529 MB/s 00000001:01000000:3.0:1789023887.132618:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 382 MB/s 00080000:10000000:0.0:1789023887.143334:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789023887.172709:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:0.0:1789023887.185643:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789023887.191882:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789023887.191970:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789023887.192038:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789023887.192354:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789023887.192383:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789023887.192802:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023887.193030:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789023887.193038:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789023887.197631:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789023887.197652:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789023887.201032:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789023887.201054:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789023887.202622:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789023887.202651:0:6492:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.118@tcp' 00000020:01000004:0.0:1789023887.202653:0:6492:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789023887.202718:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.118@tcp (typ=mgc) 00000020:00000080:0.0:1789023887.202732:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.118@tcp (000000003d3ba9d3) 00000020:00000080:0.0:1789023887.203016:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789023887.203125:0:6492:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ff9c7b09@MGC192.168.202.118@tcp: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789023887.203367:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.118@tcp-0 is initialized 00000040:01000000:0.0:1789023887.203376:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789023887.205454:0:6512:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789023887.205517:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.118@tcp (uuid 2a60d918-c836-4e5c-bd08-febd347ea726) 00000020:00000080:3.0:1789023887.205547:0:6492:0:(genops.c:1384:class_connect()) connect: client 2a60d918-c836-4e5c-bd08-febd347ea726, cookie 0xa736ef4b98cb3150 00000100:00080000:3.0:1789023887.205562:0:6492:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023887.205572:0:6492:0:(import.c:666:import_select_connection()) MGC192.168.202.118@tcp: import 00000000ff9c7b09 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789023887.205620:0:6492:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000061d2cfff x1875927422206080/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023887.205640:0:6492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2a60d918-c836-4e5c-bd08-febd347ea726->MGS 00000020:01000004:3.0:1789023887.205673:0:6492:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789023887.205679:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789023887.205704:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000427e8426) 00000020:00000080:3.0:1789023887.205725:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789023887.207628:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000061d2cfff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422206080:0@lo:250: 00000100:00100000:2.0:1789023887.207754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789023887.209008:0:6511:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789023887.210288:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206080 00000100:00100000:1.0:1789023887.210306:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206080 00000100:00100000:1.0:1789023887.210373:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.210380:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000681ffd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875927422206080:12345-0@lo:250: 00010000:00080000:1.0:1789023887.210414:0:6508:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2a60d918-c836-4e5c-bd08-febd347ea726@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1789023887.210448:0:6508:0:(genops.c:1384:class_connect()) connect: client 2a60d918-c836-4e5c-bd08-febd347ea726, cookie 0xa736ef4b98cb315e 00000100:00080000:1.0:1789023887.210596:0:6508:0:(import.c:65:import_set_state_nolock()) 00000000098e4307 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023887.210723:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000681ffd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+5:3640:x1875927422206080:12345-0@lo:250: Request processed in 342us (2969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.210732:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.218083:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789023887.218103:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.118@tcp: connect to target with instance 0 00000100:00080000:1.0:1789023887.218114:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789023887.218121:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789023887.218125:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000ff9c7b09 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789023887.218130:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789023887.218134:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789023887.218143:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000061d2cfff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422206080:0@lo:250: 00000100:00100000:3.0:1789023887.223533:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.223790:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023887.223798:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789023887.227392:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789023887.227413:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789023887.227979:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789023887.227988:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789023887.229891:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.230306:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789023887.230313:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789023887.232872:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789023887.232891:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789023887.325237:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023887.325465:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789023887.325473:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789023887.328477:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789023887.328491:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789023887.336377:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.336575:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789023887.336582:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789023887.338577:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789023887.338590:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789023887.339455:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.339634:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789023887.339640:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789023887.340341:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789023887.340348:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789023887.342336:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.342486:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789023887.342490:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789023887.343542:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789023887.343550:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789023887.369454:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023887.369687:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023887.369694:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789023887.371041:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789023887.371050:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789023887.371911:0:6492:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789023887.371920:0:6492:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789023887.376500:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789023887.376543:0:6492:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789023887.376549:0:6492:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789023887.376669:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789023887.376711:0:6492:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.118@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789023887.376868:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789023887.376870:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023887.376872:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023887.376873:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023887.376874:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023887.376876:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023887.376877:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023887.376879:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023887.376886:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023887.376887:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023887.376888:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023887.376890:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789023887.376892:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789023887.376895:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789023887.376895:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023887.376896:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023887.376897:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023887.376898:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023887.376899:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023887.376899:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023887.376900:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023887.376901:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023887.376902:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023887.376903:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023887.376904:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789023887.376934:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789023887.376954:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e90e909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206208:0@lo:253: 00000100:00100000:3.0:1789023887.377043:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.377317:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000008386bf80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.377629:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206208 00000100:00100000:0.0:1789023887.377640:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206208 00000100:00100000:0.0:1789023887.377735:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023887.377744:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061064eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+5:6492:x1875927422206208:12345-0@lo:253: 20000000:01000000:0.0:1789023887.377795:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789023887.377798:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789023887.378120:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789023887.378197:0:6510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789023887.378462:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023887.380865:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789023887.381118:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789023887.381123:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789023887.381130:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789023887.381134:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789023887.381413:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789023887.382004:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023887.382404:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789023887.382420:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023887.382438:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789023887.382452:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789023887.382535:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789023887.382602:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789023887.382610:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789023887.382623:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789023887.382639:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789023887.382655:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789023887.382659:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789023887.382671:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789023887.382991:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789023887.383025:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789023887.383035:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789023887.383044:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023887.383318:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789023887.383329:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789023887.383344:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789023887.383358:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789023887.383372:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789023887.383382:0:6510:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789023887.383405:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789023887.383413:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789023887.383424:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789023887.383438:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789023887.383451:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789023887.383458:0:6510:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789023887.383552:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789023887.383561:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789023887.383574:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789023887.383588:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789023887.383640:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789023887.383660:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789023887.383667:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789023887.384466:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789023887.386112:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789023887.386141:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.118@tcp for mdt 20000000:01000000:3.0:1789023887.386165:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023887.386183:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789023887.386189:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789023887.386219:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789023887.386225:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023887.386237:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789023887.386244:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789023887.386256:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789023887.386269:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789023887.386296:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789023887.386300:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789023887.386303:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789023887.386364:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023887.386366:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789023887.386950:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789023887.387131:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789023887.387345:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789023887.387362:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789023887.387373:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789023887.387375:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789023887.387800:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789023887.387963:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789023887.387980:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789023887.387993:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789023887.388004:0:6510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023887.388006:0:6510:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789023887.388011:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023887.388013:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023887.388018:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789023887.388133:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789023887.388641:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789023887.388974:0:6510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789023887.398113:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789023887.398465:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789023887.398779:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789023887.398803:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789023887.398827:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398857:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398877:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398884:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398891:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398897:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398904:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000045e3df5 already unused, calling callback (00000000af7802da) 00010000:00010000:2.0:1789023887.398907:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398914:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398927:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398934:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.398939:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3165 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023887.398955:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789023887.407795:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061064eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+5:6492:x1875927422206208:12345-0@lo:253: Request processed in 30042us (30742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.407816:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023887.407992:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e90e909 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206208:0@lo:253: 10000000:01000000:0.0:1789023887.408008:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789023887.408012:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023887.408014:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789023887.408016:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023887.408017:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789023887.408039:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023887.408041:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023887.408042:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023887.408043:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789023887.408044:0:6492:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789023887.408046:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023887.408047:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789023887.408065:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000073c620b3 from lustre-MDT0000 10000000:01000000:0.0:1789023887.408097:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789023887.408100:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789023887.408104:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90cc339999c0 10000000:01000000:0.0:1789023887.408108:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023887.408117:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cc339999c0 from 1 10000000:01000000:0.0:1789023887.408120:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789023887.408547:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.408559:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.408569:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.408590:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206336:0@lo:101: 00000100:00100000:0.0:1789023887.408646:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.408841:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:1.0:1789023887.408925:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206336 00000100:00100000:1.0:1789023887.408939:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206336 00000100:00100000:1.0:1789023887.408992:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023887.409000:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059eaf64c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+5:6492:x1875927422206336:12345-0@lo:101: 00010000:00010000:1.0:1789023887.409012:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023887.409025:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb316c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.409048:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.409057:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.409067:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054347c32, rc 0) 00000100:00100000:1.0:1789023887.409106:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059eaf64c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+6:6492:x1875927422206336:12345-0@lo:101: Request processed in 107us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.409112:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023887.409308:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206336:0@lo:101: 00010000:00010000:0.0:1789023887.409321:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.409329:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.409392:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206464:0@lo:501: 00000100:00100000:0.0:1789023887.409417:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.409433:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.409500:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206464 00000100:00100000:3.0:1789023887.409505:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206464 00000100:00100000:3.0:1789023887.409537:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023887.409542:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008aca7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+6:6492:x1875927422206464:12345-0@lo:501: 00000100:00100000:3.0:1789023887.409677:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008aca7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+6:6492:x1875927422206464:12345-0@lo:501: Request processed in 134us (259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023887.409683:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023887.409814:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206464:0@lo:501: 10000000:01000000:0.0:1789023887.409840:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789023887.409911:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.409920:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023887.409927:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cc199e6000 10000000:01000000:0.0:1789023887.409932:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789023887.409935:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90cc199e6000 10000000:01000000:0.0:1789023887.409938:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789023887.409941:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90cc199e6000 from 1 10000000:01000000:0.0:1789023887.409943:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789023887.409960:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.409967:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.409974:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.409985:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206592:0@lo:101: 00000100:00100000:0.0:1789023887.410017:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.410040:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:1.0:1789023887.411218:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206592 00000100:00100000:1.0:1789023887.411227:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206592 00000100:00100000:1.0:1789023887.411264:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023887.411271:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008461c776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+6:6492:x1875927422206592:12345-0@lo:101: 00010000:00010000:1.0:1789023887.411283:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023887.411297:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000023f845e7/0xa736ef4b98cb3181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb317a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.411319:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000023f845e7/0xa736ef4b98cb3181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb317a expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.411328:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000023f845e7/0xa736ef4b98cb3181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb317a expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.411349:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000023f845e7, rc 0) 00000100:00100000:1.0:1789023887.411395:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008461c776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+7:6492:x1875927422206592:12345-0@lo:101: Request processed in 125us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.411399:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789023887.411504:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206592:0@lo:101: 00010000:00010000:0.0:1789023887.411519:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.411525:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023887.411536:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789023887.428705:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.428725:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000009d2efc2d/0xa736ef4b98cb317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023887.428734:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789023887.428744:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023887.428751:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90cc199e6000 10000000:01000000:0.0:1789023887.428753:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789023887.428756:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789023887.428759:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023887.428802:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.428809:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.428821:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.428871:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206720:0@lo:101: 00000100:00100000:0.0:1789023887.428960:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.429745:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206720 00000100:00100000:2.0:1789023887.429756:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206720 00000100:00100000:2.0:1789023887.429824:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023887.429832:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ccb263c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+7:6492:x1875927422206720:12345-0@lo:101: 00010000:00010000:2.0:1789023887.429856:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023887.429870:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3188 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.429898:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.429908:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.429917:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000045e3df5, rc 0) 00000100:00100000:2.0:1789023887.429964:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ccb263c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+8:6492:x1875927422206720:12345-0@lo:101: Request processed in 133us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023887.429971:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023887.430184:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.430213:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206720:0@lo:101: 00010000:00010000:0.0:1789023887.430229:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.430238:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.430307:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206848:0@lo:501: 00000100:00100000:0.0:1789023887.430337:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.430364:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:2.0:1789023887.430619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206848 00000100:00100000:2.0:1789023887.430625:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206848 00000100:00100000:2.0:1789023887.430660:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023887.430667:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9203dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+8:6492:x1875927422206848:12345-0@lo:501: 00000100:00100000:2.0:1789023887.430798:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9203dd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+9:6492:x1875927422206848:12345-0@lo:501: Request processed in 131us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023887.430806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023887.431133:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206848:0@lo:501: 00000100:00100000:0.0:1789023887.431201:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206976:0@lo:503: 00000100:00100000:0.0:1789023887.431237:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.431265:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da8ae433 going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.431289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422206976 00000100:00100000:3.0:1789023887.431295:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422206976 00000100:00100000:3.0:1789023887.431326:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023887.431333:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000816d2e96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+9:6492:x1875927422206976:12345-0@lo:503: 00000100:00100000:3.0:1789023887.431424:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000816d2e96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+9:6492:x1875927422206976:12345-0@lo:503: Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.431430:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023887.431481:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002500db08 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422206976:0@lo:503: 00000100:00100000:2.0:1789023887.431956:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea989a89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6537:1875927422207104:0@lo:502: 00000100:00100000:2.0:1789023887.431992:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.432018:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b416881d going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.432065:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207104 00000100:00100000:3.0:1789023887.432069:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207104 00000100:00100000:3.0:1789023887.432098:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023887.432105:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a27730b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+9:6537:x1875927422207104:12345-0@lo:502: 00000100:00100000:3.0:1789023887.432219:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a27730b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+9:6537:x1875927422207104:12345-0@lo:502: Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.432228:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023887.432240:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea989a89 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6537:1875927422207104:0@lo:502: 00000020:01000000:0.0:1789023887.432269:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023887.432281:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023887.432284:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023887.432289:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789023887.432291:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023887.432305:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004d56f1ab) 00000020:00000080:0.0:1789023887.432322:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789023887.432334:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789023887.432420:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789023887.432436:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb319d 00000020:00000080:0.0:1789023887.434229:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789023887.434243:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023887.434253:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023887.434254:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023887.434258:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023887.434263:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023887.434264:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789023887.434268:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023887.434297:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008c98d34d) 00000020:00000080:0.0:1789023887.434316:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789023887.434321:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789023887.434323:0:6537:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789023887.434326:0:6537:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789023887.434333:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023887.434405:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073c620b3 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789023887.434418:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008d75fbf1) 00000020:00000080:0.0:1789023887.434425:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789023887.434494:0:6537:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789023887.434501:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb31b2 00000020:00000080:0.0:1789023887.437081:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789023887.437119:0:6537:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789023887.437130:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa736ef4b98cb31b9 00080000:01000000:0.0:1789023887.437139:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789023887.437143:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb31c0 00080000:10000000:0.0:1789023887.437602:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789023887.437738:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789023887.452620:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789023887.570529:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789023887.573139:0:6537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789023887.583124:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789023887.583528:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789023887.590616:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004509b40e) 00000020:00000080:1.0:1789023887.590642:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789023887.590768:0:6537:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789023887.590779:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb31ce 00000020:00000080:2.0:1789023887.591523:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789023887.592601:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789023887.596820:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.605118:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.615000:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.621724:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.624399:0:6537:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789023887.627047:0:6537:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa736ef4b98cb31d5 00000020:00000080:2.0:1789023887.627588:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789023887.627603:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023887.627610:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023887.627612:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789023887.627615:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023887.627620:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023887.627621:0:6537:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789023887.627624:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789023887.627625:0:6537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789023887.627628:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023887.627630:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023887.627632:0:6537:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789023887.627634:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023887.627639:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023887.627640:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789023887.627645:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789023887.627854:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789023887.627936:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6537:1875927422207232:0@lo:502: 00000100:00100000:2.0:1789023887.628041:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.628118:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f0c7595 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.628371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207232 00000100:00100000:0.0:1789023887.628387:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207232 00000100:00100000:0.0:1789023887.628431:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789023887.628437:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b5c776c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+9:6537:x1875927422207232:12345-0@lo:502: 00000100:00100000:0.0:1789023887.628563:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b5c776c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+9:6537:x1875927422207232:12345-0@lo:502: Request processed in 126us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023887.628571:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789023887.628595:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6537:1875927422207232:0@lo:502: 00000020:01000000:2.0:1789023887.628622:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023887.628628:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023887.628629:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789023887.628633:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789023887.628877:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789023887.628911:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789023887.628930:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.628944:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023887.628960:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc199e6000 from 1 10000000:01000000:3.0:1789023887.628963:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789023887.628996:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.629003:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.629013:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023887.629027:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003dc3e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207360:0@lo:101: 00000100:00100000:3.0:1789023887.629062:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023887.629095:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054d678b4 going to sleep for 11 seconds 00000100:00100000:2.0:1789023887.629112:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207360 00000100:00100000:2.0:1789023887.629118:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207360 00000100:00100000:2.0:1789023887.629355:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023887.629363:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047434471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+9:6492:x1875927422207360:12345-0@lo:101: 00010000:00010000:2.0:1789023887.629375:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023887.629390:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb31dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.629414:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.629425:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.629433:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c02e662, rc 0) 00000100:00100000:2.0:1789023887.629478:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047434471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+10:6492:x1875927422207360:12345-0@lo:101: Request processed in 116us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023887.629484:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789023887.629573:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003dc3e12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207360:0@lo:101: 00010000:00010000:0.0:1789023887.629587:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.629597:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.630209:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027e145e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207488:0@lo:256: 00000100:00100000:0.0:1789023887.630258:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.633569:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207488 00000100:00100000:1.0:1789023887.633590:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207488 00000100:00100000:1.0:1789023887.633658:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023887.633809:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000004d24aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+10:6492:x1875927422207488:12345-0@lo:256: 20000000:01000000:1.0:1789023887.633856:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789023887.633864:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789023887.634687:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a955dd5 going to sleep for 11 seconds 00000100:00100000:1.0:1789023887.638253:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000004d24aea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+10:6492:x1875927422207488:12345-0@lo:256: Request processed in 4487us (7968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.638274:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789023887.638477:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027e145e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207488:0@lo:256: 10000000:01000000:3.0:1789023887.639270:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789023887.639492:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.639506:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023887.639516:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc199e6000 from 1 10000000:01000000:3.0:1789023887.639520:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023887.640387:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.640401:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.640496:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023887.640524:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4de1216 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207616:0@lo:101: 00000100:00100000:3.0:1789023887.640762:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023887.640822:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000090613726 going to sleep for 11 seconds 00000100:00100000:2.0:1789023887.640927:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207616 00000100:00100000:2.0:1789023887.640937:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207616 00000100:00100000:2.0:1789023887.640997:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789023887.641005:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e2b4367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+10:6492:x1875927422207616:12345-0@lo:101: 00010000:00010000:2.0:1789023887.641022:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023887.641041:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb31ea expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.641068:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.641078:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.641096:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000403aceec, rc 0) 00000100:00100000:2.0:1789023887.641171:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e2b4367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422207616:12345-0@lo:101: Request processed in 166us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023887.641177:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023887.641944:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4de1216 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207616:0@lo:101: 00010000:00010000:1.0:1789023887.641965:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.641977:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023887.642317:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207744:0@lo:501: 00000100:00100000:1.0:1789023887.642375:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.642420:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c296454 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.642482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207744 00000100:00100000:0.0:1789023887.642490:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207744 00000100:00100000:0.0:1789023887.642584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023887.642593:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083d97fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422207744:12345-0@lo:501: 00000100:00100000:0.0:1789023887.642795:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083d97fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422207744:12345-0@lo:501: Request processed in 204us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023887.642804:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789023887.642852:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207744:0@lo:501: 00000100:00100000:1.0:1789023887.642901:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207872:0@lo:503: 00000100:00100000:1.0:1789023887.642941:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.647502:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c296454 going to sleep for 11 seconds 00000100:00100000:2.0:1789023887.647509:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422207872 00000100:00100000:2.0:1789023887.647527:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422207872 00000100:00100000:2.0:1789023887.647637:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023887.647647:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057593482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422207872:12345-0@lo:503: 00000040:00080000:2.0:1789023887.647726:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789023887.647828:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057593482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422207872:12345-0@lo:503: Request processed in 183us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023887.647838:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789023887.648009:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422207872:0@lo:503: 00000040:00080000:1.0:1789023887.650390:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789023887.651441:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789023887.651476:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023887.651645:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.651674:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023887.651751:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789023887.651754:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cc199e6000 10000000:01000000:2.0:1789023887.651758:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cc199e6000 10000000:01000000:2.0:1789023887.651763:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023887.651771:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc199e6000 from 1 10000000:01000000:2.0:1789023887.651775:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023887.651822:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.651859:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.651872:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023887.651901:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208000:0@lo:101: 00000100:00100000:2.0:1789023887.651987:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023887.652035:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208000 00000100:00100000:2.0:1789023887.652039:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e83ccd69 going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.652045:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208000 00000100:00100000:3.0:1789023887.652130:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023887.652139:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4f034c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+11:6492:x1875927422208000:12345-0@lo:101: 00010000:00010000:3.0:1789023887.652183:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023887.652217:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb31f8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.652245:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.652257:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023887.652267:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b285fce5, rc 0) 00000100:00100000:3.0:1789023887.652341:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4f034c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208000:12345-0@lo:101: Request processed in 203us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.652348:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789023887.652382:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208000:0@lo:101: 00010000:00010000:2.0:1789023887.652405:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.652414:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023887.652483:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208128:0@lo:501: 00000100:00100000:2.0:1789023887.652513:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023887.652540:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208128 00000100:00100000:2.0:1789023887.652544:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e83ccd69 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.652547:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208128 00000100:00100000:0.0:1789023887.652590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023887.652597:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045ab0994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208128:12345-0@lo:501: 00000100:00100000:0.0:1789023887.652751:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045ab0994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208128:12345-0@lo:501: Request processed in 154us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023887.652758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789023887.652776:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208128:0@lo:501: 00000100:00100000:2.0:1789023887.652803:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208256:0@lo:503: 00000100:00100000:2.0:1789023887.652851:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.652908:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e83ccd69 going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.652920:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208256 00000100:00100000:3.0:1789023887.652925:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208256 00000100:00100000:3.0:1789023887.652968:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023887.652975:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b4fba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208256:12345-0@lo:503: 00000100:00100000:3.0:1789023887.653074:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b4fba2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208256:12345-0@lo:503: Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.653082:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789023887.653427:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152dff27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208256:0@lo:503: 00000100:00100000:1.0:1789023887.654432:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6542:1875927422208384:0@lo:502: 00000100:00100000:1.0:1789023887.654623:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.654702:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c296454 going to sleep for 11 seconds 00000100:00100000:0.0:1789023887.654783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208384 00000100:00100000:0.0:1789023887.654790:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208384 00000100:00100000:0.0:1789023887.654831:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023887.654838:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000059c760b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6542:x1875927422208384:12345-0@lo:502: 00000100:00100000:0.0:1789023887.655767:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000059c760b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6542:x1875927422208384:12345-0@lo:502: Request processed in 924us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023887.655780:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023887.655886:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6542:1875927422208384:0@lo:502: 00000020:01000004:1.0:1789023887.656943:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789023887.656965:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009f2b1c4f) 00000020:00000080:1.0:1789023887.656993:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789023887.657344:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073c620b3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789023887.657349:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000073c620b3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789023887.657352:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000073c620b3 4 00010000:00080000:1.0:1789023887.657385:0:6542:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c0506ec9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789023887.660401:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789023887.660748:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789023887.660804:0:6542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789023887.660821:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa736ef4b98cb320d 00000100:00080000:1.0:1789023887.660833:0:6542:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789023887.660949:0:6542:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c0506ec9 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789023887.660993:0:6542:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000310881a x1875927422208512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789023887.661040:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789023887.661483:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422208512:0@lo:38: 00000100:00100000:2.0:1789023887.661583:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.661768:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208512 00000100:00100000:1.0:1789023887.661777:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208512 00000100:00100000:1.0:1789023887.661823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.661829:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000152dff27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422208512:12345-0@lo:38: 00000100:00100000:1.0:1789023887.661900:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000152dff27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422208512:12345-0@lo:38: Request processed in 70us (318us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789023887.661907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023887.661976:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023887.661985:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000c0506ec9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789023887.661989:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789023887.661992:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000310881a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422208512:0@lo:38: 00000100:00100000:1.0:1789023887.662610:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006349e9c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6542:1875927422208640:0@lo:502: 00000100:00100000:1.0:1789023887.662852:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.662918:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c20bc494 going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.666788:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208640 00000100:00100000:3.0:1789023887.666806:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208640 00000100:00100000:3.0:1789023887.666888:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023887.666898:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024961f03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6542:x1875927422208640:12345-0@lo:502: 00000100:00100000:3.0:1789023887.667278:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024961f03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6542:x1875927422208640:12345-0@lo:502: Request processed in 380us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.667287:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023887.667381:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006349e9c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:6542:1875927422208640:0@lo:502: 00000040:00080000:3.0:1789023887.667422:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789023887.667808:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789023887.667862:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023887.667922:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023887.667934:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789023887.667998:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789023887.668000:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023887.668002:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023887.668003:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023887.668005:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023887.668006:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023887.668007:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023887.668009:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023887.668010:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023887.668012:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023887.668013:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023887.668015:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023887.668019:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789023887.668022:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023887.668023:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023887.668024:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023887.668025:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023887.668026:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023887.668027:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023887.668028:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023887.668029:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023887.668036:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023887.668036:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023887.668037:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023887.668038:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023887.668064:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789023887.668081:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007baee0f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208768:0@lo:253: 00000100:00100000:2.0:1789023887.668166:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023887.668282:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084348eae going to sleep for 11 seconds 00000100:00100000:3.0:1789023887.670454:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208768 00000100:00100000:3.0:1789023887.670474:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208768 00000100:00100000:3.0:1789023887.670545:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023887.670556:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afec52c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208768:12345-0@lo:253: 20000000:01000000:3.0:1789023887.670596:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789023887.670613:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789023887.676387:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789023887.676419:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789023887.676796:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afec52c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6492:x1875927422208768:12345-0@lo:253: Request processed in 6239us (8647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023887.676812:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023887.676886:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007baee0f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:6492:1875927422208768:0@lo:253: 10000000:01000000:3.0:1789023887.676904:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789023887.676908:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789023887.676910:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023887.676924:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023887.676926:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023887.676927:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023887.676928:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023887.676930:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023887.676931:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023887.676933:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023887.676934:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023887.676936:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023887.676937:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789023887.676957:0:6492:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789023887.677201:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789023887.677207:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789023887.677234:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.677252:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.677309:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.677351:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.677370:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 11 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023887.677385:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000346b1738 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422208896:0@lo:104: 00000100:00100000:1.0:1789023887.677436:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023887.677488:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c20bc494 going to sleep for 11 seconds 00000100:00100000:1.0:1789023887.677521:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422208896 00000100:00100000:1.0:1789023887.677529:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422208896 00000100:00100000:1.0:1789023887.677575:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.677584:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f525211d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422208896:12345-0@lo:104: 00010000:00010000:1.0:1789023887.677599:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.677656:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023887.677674:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f525211d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422208896:12345-0@lo:104: Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.677681:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.677708:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000346b1738 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422208896:0@lo:104: 00010000:00010000:1.0:1789023887.677724:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.678608:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023887.678617:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.678627:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000dea903d already unused, calling callback (00000000ca6079bc) 10000000:00010000:0.0:1789023887.678630:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.678639:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023887.678645:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023887.678652:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023887.679475:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.679486:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023887.679525:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.679531:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb31dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31e3 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023887.679556:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023887.679559:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023887.679561:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023887.679649:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422209024:0@lo:103: 00000100:00100000:0.0:1789023887.680497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1789023887.688463:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789023887.688661:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789023887.688923:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789023887.689101:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789023887.689370:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789023887.689545:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1789023887.690638:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209024 00000100:00100000:1.0:1789023887.690653:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209024 00010000:00010000:1.0:1789023887.690710:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 12 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023887.690758:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023887.690767:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2a00be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+12:3642:x1875927422209024:12345-0@lo:103: 00010000:00010000:1.0:1789023887.690783:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023887.690789:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 12 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690801:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 12 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690830:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c02e662/0xa736ef4b98cb31e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb31dc expref: 12 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690860:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690868:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789023887.690888:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013681449s 00010000:00010000:1.0:1789023887.690893:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690900:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690906:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690913:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690920:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003455783e already unused, calling callback (00000000af7802da) 00010000:00010000:1.0:1789023887.690924:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690932:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690949:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.690973:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023887.691069:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2a00be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+11:3642:x1875927422209024:12345-0@lo:103: Request processed in 303us (10576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023887.691076:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789023887.691119:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.691127:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023887.691133:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003455783e/0xa736ef4b98cb3214 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023887.694957:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422209024:0@lo:103: 00080000:10000000:2.0:1789023887.697852:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.698048:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789023887.699991:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.700644:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789023887.701048:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1789023887.701995:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789023887.706923:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789023887.719864:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789023887.720070:0:6547:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789023887.720076:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789023887.720797:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789023887.723051:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789023887.723515:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789023887.729870:0:6492:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789023887.729896:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789023887.730947:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023887.732333:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023887.736642:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789023887.739455:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789023887.739585:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789023887.740776:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023887.741862:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789023887.741972:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789023887.741978:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1789023887.742730:0:6492:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789023887.743594:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789023887.743726:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789023887.743912:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789023887.744047:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789023887.744185:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789023887.744301:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789023887.744444:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789023887.744553:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789023887.744675:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789023887.744790:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789023887.744939:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789023887.745052:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789023887.745207:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789023887.745324:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789023887.745457:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789023887.745609:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789023887.746875:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789023887.747424:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789023887.747571:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789023887.747799:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789023887.747956:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789023887.748448:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789023887.748610:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789023887.748810:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789023887.748973:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789023887.749347:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789023887.749483:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789023887.749609:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789023887.749819:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789023887.749996:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789023887.751654:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789023887.751992:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789023887.752547:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789023887.757293:0:6492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789023887.757358:0:6492:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9dfe01c9b988 00100000:10000000:3.0:1789023887.757370:0:6492:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789023887.758591:0:6492:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789023887.758613:0:6492:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789023887.758641:0:6492:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789023887.758671:0:6492:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789023887.759625:0:6492:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023887.759808:0:6492:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789023888.204366:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023889.228478:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023890.252637:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023891.276768:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023892.305951:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023892.723414:0:6793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1789023892.877324:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789023892.877332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789023892.877343:0:37:0:(import.c:65:import_set_state_nolock()) 00000000c0506ec9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789023892.877360:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c0506ec9 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789023892.877385:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002cebe79b x1875927422209280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789023892.877423:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422209280:0@lo:38: 00000100:00100000:2.0:1789023892.877537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023892.877740:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023892.877748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422209152:0@lo:400: 00000100:00100000:0.0:1789023892.877780:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023892.877832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209280 00000100:00100000:0.0:1789023892.877841:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209280 00000100:00100000:0.0:1789023892.877874:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023892.877887:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064752fff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422209280:12345-0@lo:38: 00010000:00080000:0.0:1789023892.877913:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1789023892.877944:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa736ef4b98cb321b 00000004:00100000:0.0:1789023892.877983:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789023892.878117:0:6517:0:(import.c:65:import_set_state_nolock()) 000000007a422ea4 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023892.878192:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064752fff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875927422209280:12345-0@lo:38: Request processed in 305us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023892.878199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023892.878344:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209152 00000100:00100000:2.0:1789023892.878349:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209152 00000100:00100000:2.0:1789023892.878396:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789023892.878402:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfd0d690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+11:3644:x1875927422209152:12345-0@lo:400: 00000100:00100000:2.0:1789023892.878442:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfd0d690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+11:3644:x1875927422209152:12345-0@lo:400: Request processed in 40us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023892.878447:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789023892.878494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422209152:0@lo:400: 00010000:00080000:2.0:1789023892.878522:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002cebe79b x1875927422209280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789023892.878535:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789023892.878542:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789023892.878547:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789023892.878549:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000c0506ec9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789023892.878554:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422209280:0@lo:38: 00010000:00010000:0.0:1789023893.324357:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789023893.627782:0:6845:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023893.628049:0:6845:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789023894.352016:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023895.372890:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789023896.373673:0:6946:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023896.373934:0:6946:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789023896.396822:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789023896.972526:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789023896.972533:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc199e6000 from 3 10000000:01000000:0.0:1789023896.972538:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789023896.972586:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023896.972599:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023896.972612:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023896.972638:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422209408:0@lo:101: 00000100:00100000:0.0:1789023896.972711:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023896.972770:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061c11d33 going to sleep for 11 seconds 00000100:00100000:3.0:1789023896.972879:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209408 00000100:00100000:3.0:1789023896.972889:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209408 00000100:00100000:3.0:1789023896.972948:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789023896.972957:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072a13421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:6512:x1875927422209408:12345-0@lo:101: 00010000:00010000:3.0:1789023896.972971:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023896.972984:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3222 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023896.973010:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023896.973021:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023896.973029:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056eb5d65, rc 0) 00000100:00100000:3.0:1789023896.973074:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072a13421 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:6512:x1875927422209408:12345-0@lo:101: Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023896.973092:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023896.973230:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422209408:0@lo:101: 00010000:00010000:0.0:1789023896.973246:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023896.973264:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023896.973309:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422209536:0@lo:256: 00000100:00100000:0.0:1789023896.973340:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023896.973368:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061c11d33 going to sleep for 11 seconds 00000100:00100000:3.0:1789023896.973407:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209536 00000100:00100000:3.0:1789023896.973411:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209536 00000100:00100000:3.0:1789023896.973441:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789023896.973447:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017401077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6512:x1875927422209536:12345-0@lo:256: 20000000:01000000:3.0:1789023896.973461:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023896.973477:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023896.973480:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789023896.973548:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017401077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:6512:x1875927422209536:12345-0@lo:256: Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023896.973555:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789023896.973615:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422209536:0@lo:256: 10000000:01000000:0.0:1789023896.973655:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023896.973661:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023896.973668:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023897.422397:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023897.996332:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422209792:0@lo:400: 00000100:00100000:2.0:1789023897.996404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023897.996498:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422209664:0@lo:400: 00000100:00100000:0.0:1789023897.996536:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023897.996656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209792 00000100:00100000:3.0:1789023897.996666:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209792 00000100:00100000:3.0:1789023897.996714:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023897.996722:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c81509f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422209792:12345-0@lo:400: 00000100:00100000:3.0:1789023897.996797:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c81509f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422209792:12345-0@lo:400: Request processed in 75us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023897.996805:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789023897.996853:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d9187371 x1875927422209792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023897.996866:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422209792:0@lo:400: 00000100:00100000:2.0:1789023897.997076:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209664 00000100:00100000:2.0:1789023897.997081:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209664 00000100:00100000:2.0:1789023897.997118:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789023897.997124:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3616e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:3644:x1875927422209664:12345-0@lo:400: 00000100:00100000:2.0:1789023897.997215:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3616e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:3644:x1875927422209664:12345-0@lo:400: Request processed in 92us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023897.997221:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023897.997304:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422209664:0@lo:400: 00010000:00010000:2.0:1789023898.450709:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023899.469863:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023900.495458:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023901.518232:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023902.543423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023903.118104:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023903.118137:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422209920:0@lo:400: 00000100:00100000:0.0:1789023903.118252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023903.118313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007261844f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422210048:0@lo:400: 00000100:00100000:0.0:1789023903.118353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023903.118393:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422209920 00000100:00100000:0.0:1789023903.118416:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422209920 00000100:00100000:0.0:1789023903.118475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023903.118483:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057463fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:3641:x1875927422209920:12345-0@lo:400: 00000100:00100000:0.0:1789023903.118538:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057463fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:3641:x1875927422209920:12345-0@lo:400: Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023903.118546:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023903.118581:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210048 00000100:00100000:0.0:1789023903.118585:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210048 00000100:00100000:0.0:1789023903.118614:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023903.118620:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086f5ed20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422210048:12345-0@lo:400: 00000100:00100000:0.0:1789023903.118671:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086f5ed20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422210048:12345-0@lo:400: Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023903.118677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789023903.118749:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007261844f x1875927422210048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023903.118765:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007261844f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422210048:0@lo:400: 00000100:00100000:0.0:1789023903.118789:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422209920:0@lo:400: 00010000:00010000:1.0:1789023903.570874:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023904.590729:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023905.614011:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789023905.743989:0:7444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789023905.743993:0:7444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789023905.743995:0:7444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789023905.744232:0:7444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002ec290a8 00000020:01000004:0.0:1789023905.744522:0:7444:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1789023905.744532:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789023905.744547:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000008a63d791) 00000020:00000080:0.0:1789023905.744562:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789023905.817953:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789023905.818117:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789023905.863300:0:7444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789023905.863714:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789023905.863802:0:7444:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789023905.863815:0:7444:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb3237 00000020:01000004:3.0:1789023905.863822:0:7444:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789023905.863844:0:7444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789023905.863848:0:7444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789023905.863854:0:7444:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789023905.863882:0:7444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789023905.863886:0:7444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789023905.889584:0:7444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789023905.889629:0:7444:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.118@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1789023905.889633:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789023905.889635:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789023905.889636:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023905.889638:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023905.889639:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023905.889640:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023905.889642:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789023905.889643:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023905.889644:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023905.889645:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023905.889647:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023905.889650:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1789023905.889659:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789023905.889660:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789023905.889661:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023905.889662:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023905.889663:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023905.889663:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023905.889664:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789023905.889665:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023905.889666:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023905.889678:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023905.889678:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023905.889709:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789023905.889729:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000346b1738 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422210176:0@lo:253: 00000100:00100000:1.0:1789023905.889878:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023905.890008:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a732db2a going to sleep for 11 seconds 00000100:00100000:3.0:1789023905.890097:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210176 00000100:00100000:3.0:1789023905.890107:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210176 00000100:00100000:1.0:1789023905.891389:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023905.891409:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000079f4ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422210176:12345-0@lo:253: 20000000:01000000:1.0:1789023905.891469:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789023905.891475:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789023905.891482:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789023905.891486:0:6509:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789023905.891549:0:6509:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789023905.891831:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023905.891983:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789023905.891999:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789023905.892016:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789023905.892045:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789023905.892059:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789023905.892112:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789023905.892120:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789023905.892133:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789023905.892138:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789023905.892193:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789023905.892208:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789023905.892222:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789023905.892235:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789023905.892330:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1789023905.892339:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:1.0:1789023905.892351:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1789023905.892356:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789023905.892370:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1789023905.892375:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:1.0:1789023905.892387:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1789023905.892393:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789023905.892404:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789023905.892418:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789023905.892427:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789023905.892495:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1789023905.892503:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1789023905.892516:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789023905.892530:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789023905.892545:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1789023905.892550:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1789023905.892562:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789023905.892582:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789023905.892587:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1789023905.892606:0:6509:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789023905.892612:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789023905.893496:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789023905.893870:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789023905.893894:0:6509:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.118@tcp for mdt 20000000:01000000:3.0:1789023905.893896:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023905.893913:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789023905.893919:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789023905.893930:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789023905.893934:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023905.893949:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789023905.893955:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789023905.893968:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789023905.893984:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789023905.894111:0:6509:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789023905.894121:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789023905.894490:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789023905.894836:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789023905.894857:0:6509:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.118@tcp for mdt 20000000:01000000:3.0:1789023905.894858:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023905.894875:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789023905.894881:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023905.894893:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789023905.894898:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023905.894909:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789023905.894930:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789023905.894944:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789023905.894958:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789023905.894978:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789023905.894981:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789023905.894985:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789023905.895111:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023905.895114:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789023905.895628:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789023905.895656:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789023905.895682:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789023905.895960:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789023905.895980:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789023905.895997:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789023905.896007:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789023905.896010:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789023905.896425:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789023905.896444:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789023905.896458:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789023905.896700:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789023905.896720:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789023905.896811:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789023905.896824:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789023905.896825:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789023905.900608:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789023905.900680:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789023905.900710:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789023905.901231:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789023905.901253:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789023905.901268:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789023905.901283:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023905.901285:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023905.901291:0:6509:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789023905.901297:0:6509:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789023905.901707:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789023905.901882:0:6509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789023905.916453:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789023905.916531:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916552:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916577:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916583:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916590:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916635:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916648:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 12 pid: 6509 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.916661:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000327d922d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210304:0@lo:104: 00000100:00100000:3.0:1789023905.916732:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023905.916801:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916808:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.916815:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a80b3aec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210432:0@lo:104: 00000100:00100000:3.0:1789023905.916836:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023905.916903:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.916911:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.916927:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000175850e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210560:0@lo:104: 00000100:00100000:3.0:1789023905.916949:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.918690:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set 000000006dd0fcce going to sleep for 11 seconds 00000100:00100000:2.0:1789023905.921376:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210304 00000100:00100000:2.0:1789023905.921395:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210304 00000100:00100000:1.0:1789023905.921533:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210432 00000100:00100000:1.0:1789023905.921539:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210432 00000100:00100000:1.0:1789023905.921598:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210560 00000100:00100000:1.0:1789023905.921601:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210560 00000100:00100000:1.0:1789023905.921622:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023905.921632:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f581ff5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:6509:x1875927422210432:12345-0@lo:104: 00010000:00010000:1.0:1789023905.921652:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023905.921973:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a80b3aec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210432:0@lo:104: 00010000:00010000:1.0:1789023905.922003:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023905.922009:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f581ff5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:6509:x1875927422210432:12345-0@lo:104: Request processed in 379us (5173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023905.922016:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023905.922047:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023905.922054:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb8e071a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422210560:12345-0@lo:104: 00010000:00010000:1.0:1789023905.922062:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023905.922140:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000175850e6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210560:0@lo:104: 00010000:00010000:0.0:1789023905.922310:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023905.922317:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922341:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eaa4e43b already unused, calling callback (00000000ca6079bc) 10000000:00010000:0.0:1789023905.922344:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922352:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023905.922359:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023905.922364:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023905.922442:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922451:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023905.922477:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922484:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb3188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb318f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922497:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023905.922499:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922505:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002469b7e6 already unused, calling callback (00000000ca6079bc) 10000000:00010000:0.0:1789023905.922518:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.922536:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023905.922541:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023905.922545:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023905.922647:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789023905.922653:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb8e071a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422210560:12345-0@lo:104: Request processed in 600us (5703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023905.922659:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023905.922686:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023905.922693:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1d138b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422210304:12345-0@lo:104: 00010000:00010000:1.0:1789023905.922701:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.922828:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422210688:0@lo:103: 00000100:00100000:2.0:1789023905.922928:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000327d922d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422210304:0@lo:104: 00010000:00010000:2.0:1789023905.922956:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.923101:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.923108:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023905.923125:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.923131:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 000000002469b7e6/0xa736ef4b98cb316c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3173 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.923141:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023905.923143:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023905.923172:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023905.923183:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023905.923192:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007261844f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422210816:0@lo:103: 00000100:00100000:3.0:1789023905.923298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789023905.923466:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023905.923473:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1d138b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422210304:12345-0@lo:104: Request processed in 782us (6741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023905.923480:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023905.923504:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210688 00000100:00100000:1.0:1789023905.923522:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210688 00010000:00010000:1.0:1789023905.923543:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 13 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023905.923661:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023905.923680:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f29ac9cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+13:3644:x1875927422210688:12345-0@lo:103: 00010000:00010000:1.0:1789023905.923693:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023905.923698:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 13 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.923707:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 13 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.923720:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb318f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3188 expref: 13 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.923745:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023905.923781:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f29ac9cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+12:3644:x1875927422210688:12345-0@lo:103: Request processed in 114us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023905.923787:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789023905.923813:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023905.923817:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.923824:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f9c5c9c already unused, calling callback (00000000ca6079bc) 10000000:00010000:3.0:1789023905.923826:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.923833:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023905.923838:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023905.923842:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023905.923864:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.923870:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023905.923878:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.923883:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb31f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31ff expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.923905:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023905.923907:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023905.923908:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023905.924115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023905.924477:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210816 00000100:00100000:2.0:1789023905.924484:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210816 00010000:00010000:2.0:1789023905.924506:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023905.924612:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023905.924620:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000555fc090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+12:3641:x1875927422210816:12345-0@lo:103: 00010000:00010000:2.0:1789023905.924632:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023905.924636:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.924645:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.924656:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054347c32/0xa736ef4b98cb3173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb316c expref: 12 pid: 6508 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.924677:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023905.924719:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000555fc090 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+11:3641:x1875927422210816:12345-0@lo:103: Request processed in 101us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023905.924726:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023905.924960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007261844f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422210816:0@lo:103: 00000100:00100000:0.0:1789023905.924975:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023905.924983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002941f008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422210944:0@lo:103: 00000100:00100000:0.0:1789023905.925014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023905.925190:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422210944 00000100:00100000:2.0:1789023905.925195:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422210944 00010000:00010000:2.0:1789023905.925211:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 11 pid: 6509 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023905.925227:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023905.925234:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007261844f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+11:3641:x1875927422210944:12345-0@lo:103: 00010000:00010000:2.0:1789023905.925241:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023905.925244:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 11 pid: 6509 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925252:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 11 pid: 6509 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925262:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b285fce5/0xa736ef4b98cb31ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb31f8 expref: 11 pid: 6509 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925274:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925283:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925299:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925305:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925325:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925331:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925337:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000955acb3d already unused, calling callback (00000000af7802da) 00010000:00010000:2.0:1789023905.925341:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925349:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925367:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.925379:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023905.925410:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007261844f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+10:3641:x1875927422210944:12345-0@lo:103: Request processed in 177us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023905.925417:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023905.925445:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002941f008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422210944:0@lo:103: 00010000:00010000:0.0:1789023905.925629:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.925644:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.925649:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000955acb3d/0xa736ef4b98cb323e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789023905.925680:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789023905.926252:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422210688:0@lo:103: 00000100:00100000:0.0:1789023905.929049:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000079f4ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+9:7444:x1875927422210176:12345-0@lo:253: Request processed in 37640us (39163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.929065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023905.929256:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000346b1738 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422210176:0@lo:253: 10000000:01000000:3.0:1789023905.929273:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789023905.929276:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789023905.929278:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789023905.929280:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023905.929281:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1789023905.929282:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023905.929283:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023905.929284:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023905.929285:0:7444:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789023905.929287:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023905.929288:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789023905.929306:0:7444:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002ec290a8 from lustre-MDT0001 10000000:01000000:3.0:1789023905.929339:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789023905.929342:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789023905.929347:0:7444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cc339999c0 local copy 10000000:01000000:3.0:1789023905.929351:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789023905.929386:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.929396:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.929404:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.929421:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211072:0@lo:101: 00000100:00100000:3.0:1789023905.929454:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.929500:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa7321a going to sleep for 11 seconds 00000100:00100000:0.0:1789023905.929605:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211072 00000100:00100000:0.0:1789023905.929613:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211072 00000100:00100000:0.0:1789023905.929689:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789023905.929697:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022a82f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+9:7444:x1875927422211072:12345-0@lo:101: 00010000:00010000:0.0:1789023905.929710:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023905.929722:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bdef493d/0xa736ef4b98cb324c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3245 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.929807:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdef493d/0xa736ef4b98cb324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3245 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.929817:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bdef493d/0xa736ef4b98cb324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3245 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023905.929827:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bdef493d, rc 0) 00000100:00100000:0.0:1789023905.929860:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022a82f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+10:7444:x1875927422211072:12345-0@lo:101: Request processed in 165us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.929875:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023905.929925:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211072:0@lo:101: 00010000:00010000:3.0:1789023905.929936:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.929944:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.930029:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211200:0@lo:501: 00000100:00100000:3.0:1789023905.930051:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.930337:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000002fa7321a going to sleep for 11 seconds 00000100:00100000:2.0:1789023905.930418:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211200 00000100:00100000:2.0:1789023905.930423:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211200 00000100:00100000:2.0:1789023905.930446:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023905.930451:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ac0ac68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+10:7444:x1875927422211200:12345-0@lo:501: 00000100:00100000:2.0:1789023905.930577:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ac0ac68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+10:7444:x1875927422211200:12345-0@lo:501: Request processed in 126us (525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023905.930584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023905.930648:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211200:0@lo:501: 10000000:01000000:3.0:1789023905.930660:0:7444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789023905.930687:0:7444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789023905.930692:0:7444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.930699:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.930705:0:7444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.930805:0:7444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789023905.930827:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cc414b7800 10000000:01000000:3.0:1789023905.930833:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789023905.930837:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90cc339999c0 10000000:01000000:3.0:1789023905.930839:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789023905.930842:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90cc339999c0 from 1 10000000:01000000:3.0:1789023905.930848:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789023905.930864:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.930871:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.930877:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.930888:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211328:0@lo:101: 00000100:00100000:3.0:1789023905.930910:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.930929:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:2.0:1789023905.930965:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211328 00000100:00100000:2.0:1789023905.930969:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211328 00000100:00100000:2.0:1789023905.930986:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789023905.930991:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a411f3c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+10:7444:x1875927422211328:12345-0@lo:101: 00010000:00010000:2.0:1789023905.930997:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023905.931006:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003eddd3a4/0xa736ef4b98cb325a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3253 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931030:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003eddd3a4/0xa736ef4b98cb325a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3253 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931038:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003eddd3a4/0xa736ef4b98cb325a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3253 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931045:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003eddd3a4, rc 0) 00000100:00100000:2.0:1789023905.931074:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a411f3c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:7444:x1875927422211328:12345-0@lo:101: Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023905.931079:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789023905.931198:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211328:0@lo:101: 00010000:00010000:3.0:1789023905.931207:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931215:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023905.931227:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789023905.931236:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931242:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000dfe1d243/0xa736ef4b98cb3253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023905.931249:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90cc414b7800 10000000:01000000:3.0:1789023905.931252:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789023905.931255:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90cc414b7800 from 1 10000000:01000000:3.0:1789023905.931262:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789023905.931274:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931279:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931286:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.931295:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211456:0@lo:101: 00000100:00100000:3.0:1789023905.931317:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.931329:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:2.0:1789023905.931406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211456 00000100:00100000:2.0:1789023905.931411:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211456 00000100:00100000:2.0:1789023905.931428:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789023905.931433:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073a39227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:7444:x1875927422211456:12345-0@lo:101: 00010000:00010000:2.0:1789023905.931442:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023905.931449:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021150737/0xa736ef4b98cb3268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3261 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931461:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021150737/0xa736ef4b98cb3268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3261 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931467:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021150737/0xa736ef4b98cb3268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3261 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.931480:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021150737, rc 0) 00000100:00100000:3.0:1789023905.931598:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211456:0@lo:101: 00010000:00010000:3.0:1789023905.931608:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931615:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023905.931624:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789023905.931631:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931637:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000000dea903d/0xa736ef4b98cb3261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023905.931642:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789023905.931645:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789023905.931648:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90cc414b7800 10000000:01000000:3.0:1789023905.931657:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789023905.931660:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789023905.931662:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789023905.931689:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931696:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.931701:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.931710:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211584:0@lo:101: 00010000:00010000:1.0:1789023905.931945:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023905.931951:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.931969:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072ca7b72 already unused, calling callback (00000000ca6079bc) 10000000:00010000:1.0:1789023905.931972:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.931979:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023905.931985:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023905.931990:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023905.932008:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.932014:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023905.932132:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.932140:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 0000000072ca7b72/0xa736ef4b98cb3245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb324c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023905.932172:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023905.932174:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023905.932175:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023905.932184:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023905.932195:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de86ff25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422211712:0@lo:103: 00000100:00100000:3.0:1789023905.932309:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023905.932379:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073a39227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211456:12345-0@lo:101: Request processed in 945us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023905.932387:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023905.932429:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:1.0:1789023905.932492:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.932640:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211712 00000100:00100000:3.0:1789023905.932646:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211712 00000100:00100000:3.0:1789023905.932701:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023905.932709:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b1a9f93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+12:3644:x1875927422211712:12345-0@lo:103: 00010000:00010000:3.0:1789023905.932719:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023905.932731:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdef493d/0xa736ef4b98cb324c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3245 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.932756:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023905.932789:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b1a9f93 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+11:3644:x1875927422211712:12345-0@lo:103: Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023905.932795:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023905.932913:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de86ff25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422211712:0@lo:103: 00000100:00100000:2.0:1789023905.932980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211584 00000100:00100000:2.0:1789023905.932984:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211584 00000100:00100000:2.0:1789023905.933050:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789023905.933057:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c602d0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+11:7444:x1875927422211584:12345-0@lo:101: 00010000:00010000:2.0:1789023905.933066:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023905.933078:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb326f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.933092:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.933101:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000045e3df5/0xa736ef4b98cb3276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023905.933106:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000045e3df5, rc 0) 00000100:00100000:2.0:1789023905.933140:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c602d0e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211584:12345-0@lo:101: Request processed in 85us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023905.933163:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789023905.933298:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211584:0@lo:101: 00010000:00010000:3.0:1789023905.933310:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023905.933327:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023905.933436:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211840:0@lo:501: 00000100:00100000:3.0:1789023905.933463:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.933971:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:0.0:1789023905.934077:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211840 00000100:00100000:0.0:1789023905.934084:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211840 00000100:00100000:0.0:1789023905.934117:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023905.934123:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e513622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211840:12345-0@lo:501: 00000100:00100000:0.0:1789023905.934274:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e513622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211840:12345-0@lo:501: Request processed in 150us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.934281:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789023905.934457:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211840:0@lo:501: 00000100:00100000:3.0:1789023905.934629:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211968:0@lo:503: 00000100:00100000:3.0:1789023905.934688:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.934716:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:0.0:1789023905.934886:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422211968 00000100:00100000:0.0:1789023905.934892:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422211968 00000100:00100000:0.0:1789023905.934913:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789023905.934919:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000767f68a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211968:12345-0@lo:503: 00000100:00100000:0.0:1789023905.935011:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000767f68a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422211968:12345-0@lo:503: Request processed in 92us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.935031:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789023905.935200:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422211968:0@lo:503: 00000040:00080000:3.0:1789023905.935501:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789023905.935680:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212096:0@lo:502: 00000100:00100000:3.0:1789023905.935722:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.935868:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:0.0:1789023905.935938:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212096 00000100:00100000:0.0:1789023905.935945:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212096 00000100:00100000:0.0:1789023905.935971:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789023905.935978:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048a011bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422212096:12345-0@lo:502: 00000100:00100000:0.0:1789023905.936237:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048a011bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422212096:12345-0@lo:502: Request processed in 260us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.936244:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789023905.936483:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212096:0@lo:502: 00000040:00080000:3.0:1789023905.936985:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789023905.937092:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789023905.937113:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789023905.937128:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789023905.937140:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789023905.937323:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789023905.937343:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789023905.937356:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789023905.937371:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789023905.937384:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789023905.937408:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789023905.937420:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789023905.937431:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789023905.937442:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789023905.937454:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789023905.937466:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789023905.937477:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789023905.937489:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789023905.937501:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789023905.937594:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789023905.937612:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789023905.937626:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789023905.937640:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789023905.937689:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212224:0@lo:502: 00000100:00100000:3.0:1789023905.937881:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023905.937969:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:0.0:1789023905.938012:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212224 00000100:00100000:0.0:1789023905.938092:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212224 00000100:00100000:0.0:1789023905.938373:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789023905.938385:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f557b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422212224:12345-0@lo:502: 00000100:00100000:0.0:1789023905.938624:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f557b18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422212224:12345-0@lo:502: Request processed in 241us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023905.938632:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023905.938710:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212224:0@lo:502: 00000040:00080000:3.0:1789023905.938915:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789023905.938927:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1789023905.939907:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023905.939922:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023905.939924:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789023905.939930:0:7456:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789023905.939933:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023905.939947:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000577da91d) 00000020:00000080:0.0:1789023905.939969:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1789023905.939976:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789023905.940250:0:7456:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789023905.940259:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb3284 00000020:00000080:0.0:1789023905.940880:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789023905.940887:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023905.940892:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023905.940894:0:7456:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789023905.940897:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023905.940902:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023905.940904:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789023905.940907:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023905.940927:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f4dfa917) 00000020:00000080:0.0:1789023905.940943:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789023905.940948:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789023905.940950:0:7456:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789023905.940954:0:7456:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789023905.940961:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023905.941122:0:7456:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002ec290a8 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789023905.941137:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000f331d087) 00000020:00000080:0.0:1789023905.941495:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789023905.941679:0:7456:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789023905.941686:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb3299 00000020:00000080:0.0:1789023905.941886:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789023905.941893:0:7456:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789023905.941898:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa736ef4b98cb32a0 00080000:01000000:0.0:1789023905.941905:0:7456:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789023905.941909:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb32a7 00080000:10000000:0.0:1789023905.942971:0:7456:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789023905.943271:0:7456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789023906.066242:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789023906.067799:0:7456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789023906.069829:0:7456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789023906.070205:0:7456:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789023906.077025:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789023906.077042:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023906.077050:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.077052:0:7456:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789023906.077058:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023906.077065:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.077066:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789023906.077069:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789023906.077075:0:7456:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:00000080:3.0:1789023906.077104:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789023906.077118:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000ba82d8d7) 00000020:00000080:3.0:1789023906.077140:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789023906.077167:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789023906.077242:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789023906.077249:0:7456:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789023906.077269:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb32b5 00010000:00080000:3.0:1789023906.077300:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a2151503@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789023906.081956:0:7456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789023906.083443:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789023906.083458:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789023906.083494:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789023906.083525:0:7456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb32bc 00000100:00080000:3.0:1789023906.083536:0:7456:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023906.083547:0:7456:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000a2151503 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789023906.083590:0:7456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cbdba91e x1875927422212352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023906.083616:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789023906.083686:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023906.083691:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083693:0:7456:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789023906.083695:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789023906.083698:0:7456:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789023906.083699:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023906.083701:0:7456:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023906.083702:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789023906.083704:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083705:0:7456:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789023906.083707:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023906.083711:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083713:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789023906.083716:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789023906.083747:0:7456:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789023906.083761:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023906.083764:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083773:0:7456:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789023906.083776:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023906.083778:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083779:0:7456:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023906.083782:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023906.083783:0:7456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789023906.083811:0:7456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023906.083814:0:7456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023906.083815:0:7456:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023906.083818:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789023906.083872:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789023906.083901:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789023906.083923:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023906.083934:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000009a16797f/0xa736ef4b98cb326f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023906.083942:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc414b7800 from 1 10000000:01000000:3.0:1789023906.083944:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789023906.083970:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023906.083978:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023906.083989:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023906.084008:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000719499b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212480:0@lo:101: 00000100:00100000:3.0:1789023906.084180:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023906.084236:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000000060d217 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.084474:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422212352:0@lo:38: 00000100:00100000:3.0:1789023906.085903:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de86ff25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422212608:0@lo:400: 00000100:00100000:3.0:1789023906.085968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023906.086120:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212608 00000100:00100000:1.0:1789023906.086131:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212608 00000100:00100000:1.0:1789023906.086210:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023906.086220:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000036d6034 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422212608:12345-0@lo:400: 00000100:00100000:1.0:1789023906.086285:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000036d6034 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422212608:12345-0@lo:400: Request processed in 67us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023906.086292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789023906.086377:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000de86ff25 x1875927422212608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023906.086392:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de86ff25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422212608:0@lo:400: 00000100:00100000:0.0:1789023906.086818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212480 00000100:00100000:0.0:1789023906.086825:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212480 00000100:00100000:2.0:1789023906.086929:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.087099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789023906.087108:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000534e6ad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+12:7444:x1875927422212480:12345-0@lo:101: 00010000:00010000:0.0:1789023906.087121:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023906.087140:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb32c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.087190:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.087202:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.087211:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002469b7e6, rc 0) 00000100:00100000:0.0:1789023906.087254:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000534e6ad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+13:7444:x1875927422212480:12345-0@lo:101: Request processed in 147us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023906.087260:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789023906.087925:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212352 00000100:00100000:3.0:1789023906.087934:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212352 00000100:00100000:3.0:1789023906.087970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023906.087976:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000edb6743a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422212352:12345-0@lo:38: 00010000:00080000:3.0:1789023906.087999:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1789023906.088044:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb32d1 00000004:00100000:3.0:1789023906.088058:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789023906.088063:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789023906.088389:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000719499b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212480:0@lo:101: 00010000:00010000:0.0:1789023906.088407:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.088417:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023906.088990:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212736:0@lo:256: 00000100:00100000:0.0:1789023906.089124:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.089385:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f7cb3f going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.089439:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212736 00000100:00100000:2.0:1789023906.089447:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212736 00000100:00100000:2.0:1789023906.089527:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789023906.089543:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000291466b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+13:7444:x1875927422212736:12345-0@lo:256: 20000000:01000000:2.0:1789023906.089561:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789023906.089579:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789023906.089583:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789023906.089817:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000291466b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+13:7444:x1875927422212736:12345-0@lo:256: Request processed in 275us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.089825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789023906.089904:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212736:0@lo:256: 10000000:01000000:0.0:1789023906.090749:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023906.090819:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.090832:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023906.090840:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc414b7800 from 1 10000000:01000000:0.0:1789023906.090843:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023906.090878:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.090886:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.090895:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023906.090914:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212864:0@lo:101: 00000100:00100000:0.0:1789023906.090956:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.091049:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f7cb3f going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.091319:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212864 00000100:00100000:2.0:1789023906.091326:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212864 00000100:00100000:2.0:1789023906.091371:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789023906.091378:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004dd95bf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+13:7444:x1875927422212864:12345-0@lo:101: 00010000:00010000:2.0:1789023906.091390:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023906.091401:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb32d8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.091424:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.091433:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.091441:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3520af9, rc 0) 00000100:00100000:2.0:1789023906.091484:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004dd95bf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422212864:12345-0@lo:101: Request processed in 107us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.091490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789023906.091572:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212864:0@lo:101: 00010000:00010000:0.0:1789023906.091584:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.092257:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023906.092378:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212992:0@lo:501: 00000100:00100000:0.0:1789023906.092416:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.092447:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5f7cb3f going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.092611:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422212992 00000100:00100000:2.0:1789023906.092618:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422212992 00000100:00100000:2.0:1789023906.092644:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789023906.092650:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000096adeda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422212992:12345-0@lo:501: 00000100:00100000:2.0:1789023906.092779:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000096adeda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422212992:12345-0@lo:501: Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.092786:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789023906.092828:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000228df4a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422212992:0@lo:501: 00000100:00100000:2.0:1789023906.092857:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213120:0@lo:503: 00000100:00100000:2.0:1789023906.092896:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.092916:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a9803b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.092930:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213120 00000100:00100000:2.0:1789023906.092934:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213120 00000100:00100000:2.0:1789023906.092950:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023906.092956:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e5cd7ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422213120:12345-0@lo:503: 00000040:00080000:2.0:1789023906.092987:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789023906.093038:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e5cd7ef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422213120:12345-0@lo:503: Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.093045:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023906.093084:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213120:0@lo:503: 00000040:00080000:2.0:1789023906.093385:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023906.093436:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789023906.093510:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023906.094125:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1789023906.094200:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789023906.094221:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023906.094238:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094249:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023906.094307:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789023906.094310:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cc414b7800 10000000:01000000:2.0:1789023906.094313:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cc414b7800 10000000:01000000:2.0:1789023906.094317:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023906.094322:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc414b7800 from 1 10000000:01000000:2.0:1789023906.094325:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023906.094356:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094363:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094372:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.094388:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213248:0@lo:101: 00000100:00100000:2.0:1789023906.094434:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.094464:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4e9cc4a going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.094482:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213248 00000100:00100000:2.0:1789023906.094487:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213248 00000100:00100000:2.0:1789023906.094513:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789023906.094519:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000a3e8004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:7444:x1875927422213248:12345-0@lo:101: 00010000:00010000:2.0:1789023906.094530:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023906.094539:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c02e662/0xa736ef4b98cb32ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb32e6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094561:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c02e662/0xa736ef4b98cb32ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094581:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c02e662/0xa736ef4b98cb32ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094590:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c02e662, rc 0) 00000100:00100000:2.0:1789023906.094622:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000a3e8004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213248:12345-0@lo:101: Request processed in 103us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.094628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789023906.094688:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213248:0@lo:101: 00010000:00010000:2.0:1789023906.094701:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.094709:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.094770:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213376:0@lo:501: 00000100:00100000:2.0:1789023906.094791:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.094805:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4e9cc4a going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.094816:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213376 00000100:00100000:2.0:1789023906.094820:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213376 00000100:00100000:2.0:1789023906.094836:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023906.094841:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cef0b58d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213376:12345-0@lo:501: 00000100:00100000:2.0:1789023906.094948:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cef0b58d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213376:12345-0@lo:501: Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.094955:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023906.094986:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213376:0@lo:501: 00000100:00100000:2.0:1789023906.095010:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213504:0@lo:503: 00000100:00100000:2.0:1789023906.095047:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.095060:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037300d90 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.095073:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213504 00000100:00100000:2.0:1789023906.095076:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213504 00000100:00100000:2.0:1789023906.095093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789023906.095097:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c77fb66c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213504:12345-0@lo:503: 00000100:00100000:2.0:1789023906.095204:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c77fb66c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213504:12345-0@lo:503: Request processed in 106us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.095211:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789023906.095249:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213504:0@lo:503: 00000040:00080000:2.0:1789023906.095493:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789023906.095555:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213632:0@lo:502: 00000100:00100000:2.0:1789023906.095586:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.095607:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037300d90 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.095619:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213632 00000100:00100000:2.0:1789023906.095623:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213632 00000100:00100000:2.0:1789023906.095639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789023906.095643:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002c2e8e7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213632:12345-0@lo:502: 00000100:00100000:2.0:1789023906.100106:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002c2e8e7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213632:12345-0@lo:502: Request processed in 4454us (4512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.100123:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023906.100419:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009909bda pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213632:0@lo:502: 00000040:00080000:0.0:1789023906.100657:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789023906.100701:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789023906.100719:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789023906.100733:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789023906.100747:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789023906.100758:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789023906.100769:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789023906.100780:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789023906.100790:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789023906.100803:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789023906.100815:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789023906.100826:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789023906.100840:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789023906.100854:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789023906.100868:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789023906.100882:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789023906.100895:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789023906.100909:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789023906.100921:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789023906.100931:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789023906.100941:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789023906.100951:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789023906.100989:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789023906.101005:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789023906.101033:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789023906.101050:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789023906.101063:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789023906.101076:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1789023906.101118:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe724526 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213760:0@lo:502: 00000100:00100000:0.0:1789023906.101221:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.101265:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c5b8d46 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.101536:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213760 00000100:00100000:2.0:1789023906.101545:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213760 00000100:00100000:2.0:1789023906.101592:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789023906.101614:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcd81b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213760:12345-0@lo:502: 00000100:00100000:2.0:1789023906.101728:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcd81b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422213760:12345-0@lo:502: Request processed in 116us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.101741:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023906.102061:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe724526 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422213760:0@lo:502: 00000040:00080000:0.0:1789023906.102120:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789023906.102131:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789023906.102702:0:7462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789023906.102717:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000217a6b1d) 00000020:00000080:3.0:1789023906.102736:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789023906.102824:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002ec290a8 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789023906.102829:0:7462:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002ec290a8 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789023906.102831:0:7462:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002ec290a8 3 00010000:00080000:3.0:1789023906.102859:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000087c2be66@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:3.0:1789023906.104514:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789023906.104736:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789023906.104773:0:7462:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789023906.104784:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa736ef4b98cb32fb 00000100:00080000:3.0:1789023906.104794:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023906.104804:0:7462:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000087c2be66 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789023906.104856:0:7462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000056bff1dd x1875927422213888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023906.104887:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 40000000:00080000:2.0:1789023906.106780:0:7464:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:2.0:1789023906.106906:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1789023906.107185:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056bff1dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422213888:0@lo:38: 00000100:00100000:0.0:1789023906.107265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.107339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422213888 00000100:00100000:0.0:1789023906.107348:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422213888 00000100:00100000:0.0:1789023906.107389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023906.107396:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe724526 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422213888:12345-0@lo:38: 00010000:00080000:0.0:1789023906.107430:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1789023906.107464:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa736ef4b98cb3302 00000004:00100000:0.0:1789023906.107478:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789023906.107512:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000cae62a26 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023906.107572:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe724526 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875927422213888:12345-0@lo:38: Request processed in 175us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023906.107580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789023906.107624:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000056bff1dd x1875927422213888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023906.107634:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789023906.107651:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789023906.107659:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789023906.107664:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789023906.107679:0:3640:0:(import.c:65:import_set_state_nolock()) 0000000087c2be66 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789023906.107686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056bff1dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422213888:0@lo:38: 00000020:01000000:0.0:1789023906.107716:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789023906.107746:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023906.107758:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023906.107769:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000bfc9d1e3/0xa736ef4b98cb32e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789023906.107816:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789023906.107818:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789023906.107819:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023906.107821:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023906.107822:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023906.107824:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023906.107825:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023906.107826:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023906.107827:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023906.107829:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023906.107830:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023906.107834:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789023906.107837:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789023906.107838:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789023906.107839:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023906.107840:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023906.107841:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023906.107842:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023906.107843:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023906.107844:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023906.107844:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023906.107850:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023906.107851:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023906.107870:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789023906.107882:0:7444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422214016:0@lo:253: 00000100:00100000:0.0:1789023906.107914:0:7444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023906.107931:0:7444:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c5b8d46 going to sleep for 11 seconds 00000100:00100000:0.0:1789023906.107949:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214016 00000100:00100000:0.0:1789023906.107953:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214016 00000100:00100000:0.0:1789023906.107984:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789023906.107990:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da09b063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:7444:x1875927422214016:12345-0@lo:253: 20000000:01000000:0.0:1789023906.108010:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789023906.108039:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789023906.112499:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789023906.112514:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789023906.112578:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789023906.112583:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789023906.112606:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112627:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112635:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112641:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112697:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112711:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 15 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.112724:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de1f21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422214144:0@lo:104: 00000100:00100000:2.0:1789023906.112806:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023906.112859:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.112883:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 15 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.112892:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422214272:0@lo:104: 00000100:00100000:2.0:1789023906.112929:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.112947:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000973675b9 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.112970:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214144 00000100:00100000:2.0:1789023906.112978:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214144 00000100:00100000:2.0:1789023906.113014:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214272 00000100:00100000:2.0:1789023906.113024:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214272 00000100:00100000:2.0:1789023906.113041:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023906.113049:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000125f19e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6531:x1875927422214144:12345-0@lo:104: 00010000:00010000:2.0:1789023906.113061:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113112:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023906.113118:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000125f19e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6531:x1875927422214144:12345-0@lo:104: Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.113125:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023906.113142:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023906.113243:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b490421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422214272:12345-0@lo:104: 00010000:00010000:2.0:1789023906.113251:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113285:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789023906.113289:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b490421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422214272:12345-0@lo:104: Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.113306:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789023906.113344:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023906.113350:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113357:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000125c89d6 already unused, calling callback (00000000ca6079bc) 10000000:00010000:2.0:1789023906.113361:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113369:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023906.113375:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023906.113380:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023906.113408:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113415:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789023906.113432:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113438:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 00000000125c89d6/0xa736ef4b98cb32c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ca expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113447:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023906.113450:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113465:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3256751 already unused, calling callback (00000000ca6079bc) 10000000:00010000:2.0:1789023906.113467:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113473:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023906.113479:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023906.113483:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023906.113496:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113502:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789023906.113506:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113512:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 00000000a3256751/0xa736ef4b98cb3222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3229 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113524:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023906.113526:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023906.113528:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023906.113534:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023906.113548:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000558a56a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422214400:0@lo:103: 00000100:00100000:2.0:1789023906.113575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.113604:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023906.113610:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3f34c6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422214528:0@lo:103: 00000100:00100000:2.0:1789023906.113644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.113692:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214400 00000100:00100000:2.0:1789023906.113697:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214400 00010000:00010000:2.0:1789023906.113716:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 16 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.113735:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214528 00000100:00100000:2.0:1789023906.113738:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214528 00010000:00010000:2.0:1789023906.113747:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 17 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.113758:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023906.113763:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006094d4dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422214400:12345-0@lo:103: 00010000:00010000:2.0:1789023906.113772:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023906.113776:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 17 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113784:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 17 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113798:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023906.113825:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006094d4dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422214400:12345-0@lo:103: Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.113830:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023906.113843:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023906.113848:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d43586e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+16:3641:x1875927422214528:12345-0@lo:103: 00010000:00010000:2.0:1789023906.113856:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023906.113859:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 16 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113877:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 16 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113888:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113895:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023906.113910:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013681449s 00010000:00010000:2.0:1789023906.113913:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113919:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113924:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113929:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113933:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068e0af17 already unused, calling callback (00000000af7802da) 00010000:00010000:2.0:1789023906.113936:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113943:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113950:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.113969:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023906.113996:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d43586e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+16:3641:x1875927422214528:12345-0@lo:103: Request processed in 148us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.114001:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023906.114071:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3f34c6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422214528:0@lo:103: 00000100:00100000:2.0:1789023906.114080:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000558a56a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422214400:0@lo:103: 00010000:00010000:2.0:1789023906.114105:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002469b7e6/0xa736ef4b98cb32ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb32c3 expref: 15 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.114114:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de1f21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422214144:0@lo:104: 00010000:00010000:2.0:1789023906.114120:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000056eb5d65/0xa736ef4b98cb3229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3222 expref: 14 pid: 6510 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023906.114127:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422214272:0@lo:104: 00010000:00010000:2.0:1789023906.114140:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.114172:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.114178:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023906.114183:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068e0af17/0xa736ef4b98cb3309 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789023906.115055:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000c22bc78e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023906.115138:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000edb6743a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422212352:12345-0@lo:38: Request processed in 27160us (28209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023906.115171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023906.115515:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023906.115533:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789023906.115542:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789023906.115548:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789023906.115550:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000a2151503 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789023906.115566:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbdba91e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422212352:0@lo:38: 00000100:00100000:2.0:1789023906.115620:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023906.115630:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422214656:0@lo:41: 00000100:00100000:2.0:1789023906.115663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.115720:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214656 00000100:00100000:2.0:1789023906.115727:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214656 00000100:00100000:2.0:1789023906.115762:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023906.115770:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de1f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875927422214656:12345-0@lo:41: 00000100:00100000:3.0:1789023906.115933:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da09b063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+13:7444:x1875927422214016:12345-0@lo:253: Request processed in 7943us (8018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023906.115941:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00000024:2.0:1789023906.115996:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789023906.117994:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de1f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875927422214656:12345-0@lo:41: Request processed in 2220us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.118008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023906.118272:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422214656:0@lo:41: 00000100:00100000:1.0:1789023906.123261:0:7444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:7444:1875927422214016:0@lo:253: 10000000:01000000:1.0:1789023906.123284:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789023906.123288:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789023906.123289:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789023906.123291:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023906.123292:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023906.123294:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023906.123295:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023906.123296:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789023906.123297:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023906.123298:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023906.123300:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023906.123301:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789023906.123315:0:7444:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789023906.137654:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.137842:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789023906.138038:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.138414:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789023906.138579:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.138743:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789023906.145172:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.145415:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789023906.145573:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.145726:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789023906.145888:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1789023906.146091:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789023906.148189:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1789023906.149102:0:7468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789023906.149196:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1574e3d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1875927422214784:0@lo:700: 00000100:00100000:3.0:1789023906.149274:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023906.149312:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab71218 going to sleep for 11 seconds 00000040:01000000:2.0:1789023906.149395:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789023906.149612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214784 00000100:00100000:0.0:1789023906.149623:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214784 00000100:00100000:0.0:1789023906.149690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023906.149700:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064972809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1875927422214784:12345-0@lo:700: 00000100:00100000:0.0:1789023906.150607:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2e395be pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422214912:0@lo:1000: 00000100:00100000:0.0:1789023906.150682:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.150706:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422214912 00000100:00100000:2.0:1789023906.150713:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422214912 00000100:00100000:0.0:1789023906.150720:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000acedb6a7 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.150760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023906.150767:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efa688b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7469:x1875927422214912:12345-0@lo:1000: 00000100:00100000:2.0:1789023906.150889:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efa688b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7469:x1875927422214912:12345-0@lo:1000: Request processed in 123us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.150896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023906.150937:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2e395be pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422214912:0@lo:1000: 00000040:01000000:2.0:1789023906.150984:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1789023906.151006:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215040:0@lo:700: 00000100:00100000:2.0:1789023906.151037:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.151050:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069152ad4 going to sleep for 11 seconds 00000040:01000000:3.0:1789023906.151216:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789023906.151330:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789023906.151756:0:7444:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789023906.151764:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789023906.151889:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023906.152837:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789023906.153372:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789023906.153404:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789023906.153589:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789023906.154165:0:7467:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789023906.154170:0:7467:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789023906.154260:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215040 00000100:00100000:0.0:1789023906.154272:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215040 00000100:00100000:0.0:1789023906.154326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023906.154335:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000558a56a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7469:x1875927422215040:12345-0@lo:700: 00000100:00100000:0.0:1789023906.154469:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000558a56a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+6:7469:x1875927422215040:12345-0@lo:700: Request processed in 134us (3430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023906.154476:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:0.0:1789023906.156277:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 40000000:02000000:0.0:1789023906.156312:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1789023906.156482:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215040:0@lo:700: 00000100:00100000:2.0:1789023906.157388:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875927422215168:0@lo:900: 00000100:00100000:2.0:1789023906.157453:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.157487:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069152ad4 going to sleep for 11 seconds 00000100:00100000:1.0:1789023906.160243:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215168 00000100:00100000:1.0:1789023906.160264:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215168 00000100:00100000:1.0:1789023906.160329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023906.160338:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f34c6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1875927422215168:12345-0@lo:900: 00000100:00100000:1.0:1789023906.160462:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f34c6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7469:x1875927422215168:12345-0@lo:900: Request processed in 124us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023906.160469:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023906.160589:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f0b36f4 x1875927422215168/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789023922 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023906.160605:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875927422215168:0@lo:900: 00000100:00100000:2.0:1789023906.160739:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215296:0@lo:1000: 00000100:00100000:2.0:1789023906.160788:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.160818:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215296 00000100:00100000:2.0:1789023906.160822:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215296 00000100:00100000:2.0:1789023906.160862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023906.160868:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006094d4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215296:12345-0@lo:1000: 00000100:00100000:2.0:1789023906.160923:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006094d4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215296:12345-0@lo:1000: Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023906.160929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023906.160957:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9d11177 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.160970:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215296:0@lo:1000: 00000004:00080000:2.0:1789023906.161010:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000069152ad4 with version 0 00000020:00100000:2.0:1789023906.161023:0:7469:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789023906.161028:0:7469:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008f0b36f4 x1875927422215552/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789023906.161044:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215552:0@lo:1000: 00000100:00100000:2.0:1789023906.161069:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.161087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215552 00000100:00100000:2.0:1789023906.161090:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215552 00000100:00100000:2.0:1789023906.161107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023906.161112:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ad45528 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215552:12345-0@lo:1000: 00000100:00100000:2.0:1789023906.161492:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530b796c going to sleep for 11 seconds 00080000:10000000:3.0:1789023906.162099:0:7444:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789023906.162950:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789023906.163103:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789023906.166031:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789023906.166928:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789023906.167109:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789023906.167382:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789023906.167534:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789023906.167680:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789023906.167830:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789023906.167971:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789023906.168121:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789023906.168272:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789023906.168415:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789023906.168565:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:0.0:1789023906.170238:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064972809 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7468:x1875927422214784:12345-0@lo:700: Request processed in 20531us (20957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023906.170253:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789023906.170889:0:7468:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a1574e3d x1875927422214784/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789023922 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023906.170905:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1574e3d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7468:1875927422214784:0@lo:700: 40000000:02000000:3.0:1789023906.170919:0:7468:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1789023906.172046:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789023906.172396:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789023906.172761:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789023906.180518:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789023906.180703:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789023906.180855:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789023906.181013:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789023906.181177:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789023906.181326:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789023906.181478:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789023906.181605:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789023906.181750:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789023906.181890:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789023906.182039:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789023906.182203:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789023906.182338:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789023906.182483:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789023906.182624:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789023906.182864:0:7444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789023906.189410:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789023906.189542:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ad45528 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215552:12345-0@lo:1000: Request processed in 28426us (28469us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789023906.189563:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789023906.189625:0:7469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789023906.189629:0:7469:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789023906.189646:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215552:0@lo:1000: 00000100:00100000:2.0:1789023906.189746:0:7469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215680:0@lo:1000: 00000100:00100000:2.0:1789023906.189784:0:7469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023906.189835:0:7469:0:(client.c:2716:ptlrpc_set_wait()) set 000000007542f306 going to sleep for 11 seconds 00000100:00100000:1.0:1789023906.189907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215680 00000100:00100000:1.0:1789023906.189916:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215680 00000100:00100000:1.0:1789023906.189971:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023906.189981:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043fc8ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215680:12345-0@lo:1000: 00000100:00100000:1.0:1789023906.190063:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043fc8ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7469:x1875927422215680:12345-0@lo:1000: Request processed in 84us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023906.190070:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789023906.190189:0:7469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7469:1875927422215680:0@lo:1000: 00000040:00080000:3.0:1789023906.190232:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789023906.190262:0:7469:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000035702603 with version 1 00000004:00080000:1.0:1789023906.191377:0:7459:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000509d47ed version 1 rpc_version 1 00000020:00100000:1.0:1789023906.191409:0:7459:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789023906.191419:0:7459:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008fd1150f x1875927422215936/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023906.191439:0:7459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fd1150f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1875927422215936:0@lo:1000: 00000100:00100000:1.0:1789023906.191489:0:7459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023906.191520:0:7459:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cd9f8b25 going to sleep for 11 seconds 00000100:00100000:2.0:1789023906.192061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422215936 00000100:00100000:2.0:1789023906.192070:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422215936 00000100:00100000:2.0:1789023906.192123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023906.192132:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012493d62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1875927422215936:12345-0@lo:1000: 00000040:00080000:3.0:1789023906.196617:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789023906.196722:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:2.0:1789023906.199744:0:7444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789023906.199777:0:7444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9dfe01c63988 00100000:10000000:2.0:1789023906.199783:0:7444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:2.0:1789023906.202356:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000020:01000004:2.0:1789023906.202431:0:7444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789023906.202464:0:7444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789023906.202486:0:7444:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789023906.202503:0:7444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:0.0:1789023906.208223:0:7468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023906.215234:0:7468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789023906.215317:0:7468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789023906.215322:0:7468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:3.0:1789023906.216328:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012493d62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1875927422215936:12345-0@lo:1000: Request processed in 24193us (24834us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789023906.216342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000004:3.0:1789023906.217243:0:7444:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023906.217438:0:7444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:0.0:1789023906.218533:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789023906.218540:0:7459:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789023906.218563:0:7459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fd1150f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1875927422215936:0@lo:1000: 00010000:00010000:2.0:1789023906.636629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023907.660608:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023908.689013:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023909.708325:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023910.564217:0:7714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789023910.732436:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023911.308479:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023911.308530:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422216064:0@lo:41: 00000100:00100000:0.0:1789023911.308629:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023911.308771:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216064 00000100:00100000:2.0:1789023911.308781:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216064 00000100:00100000:2.0:1789023911.308844:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023911.308853:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037236eca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422216064:12345-0@lo:41: 00000004:00000024:2.0:1789023911.308903:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789023911.308962:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037236eca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422216064:12345-0@lo:41: Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023911.308986:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023911.309013:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff0fee3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422216192:0@lo:400: 00000100:00100000:2.0:1789023911.309047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023911.309081:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023911.309086:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9b3e4ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422216320:0@lo:400: 00000100:00100000:2.0:1789023911.309113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023911.309188:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216320 00000100:00100000:2.0:1789023911.309192:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216320 00000100:00100000:2.0:1789023911.309220:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023911.309227:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009909bda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422216320:12345-0@lo:400: 00000100:00100000:1.0:1789023911.309236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216192 00000100:00100000:1.0:1789023911.309241:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216192 00000100:00100000:2.0:1789023911.309265:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009909bda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422216320:12345-0@lo:400: Request processed in 40us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023911.309272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023911.309288:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023911.309294:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acb37657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+13:3641:x1875927422216192:12345-0@lo:400: 00010000:00080000:2.0:1789023911.309304:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f9b3e4ec x1875927422216320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023911.309320:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9b3e4ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422216320:0@lo:400: 00000100:00100000:1.0:1789023911.309327:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acb37657 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+13:3641:x1875927422216192:12345-0@lo:400: Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023911.309329:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff0fee3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422216192:0@lo:400: 00000100:00100000:1.0:1789023911.309333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789023911.309467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062bc016d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422216448:0@lo:400: 00000100:00100000:0.0:1789023911.309496:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023911.309524:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422216064:0@lo:41: 00000100:00100000:1.0:1789023911.309595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216448 00000100:00100000:1.0:1789023911.309600:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216448 00000100:00100000:1.0:1789023911.309648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023911.309653:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000138a48db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422216448:12345-0@lo:400: 00000100:00100000:1.0:1789023911.309695:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000138a48db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422216448:12345-0@lo:400: Request processed in 42us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023911.309701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789023911.309764:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000062bc016d x1875927422216448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023911.309775:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062bc016d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422216448:0@lo:400: 00000020:00000004:3.0:1789023911.505415:0:7766:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023911.505656:0:7766:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789023911.757375:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023912.782899:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023913.356314:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789023913.356327:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc414b7800 from 4 10000000:01000000:2.0:1789023913.356335:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789023913.356400:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.356416:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.356428:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.356481:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216576:0@lo:101: 00000100:00100000:2.0:1789023913.356710:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023913.356907:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216576 00000100:00100000:3.0:1789023913.356918:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216576 00000100:00100000:2.0:1789023913.357206:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.363656:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789023913.363688:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092c12e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+13:6512:x1875927422216576:12345-0@lo:101: 00010000:00010000:3.0:1789023913.363712:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023913.363737:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b70aceb/0xa736ef4b98cb3317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3310 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.363782:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b70aceb/0xa736ef4b98cb3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.363797:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b70aceb/0xa736ef4b98cb3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.363806:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b70aceb, rc 0) 00000100:00100000:3.0:1789023913.363922:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092c12e2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:6512:x1875927422216576:12345-0@lo:101: Request processed in 253us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.363930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023913.364464:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216576:0@lo:101: 00010000:00010000:2.0:1789023913.364489:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.364502:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.364617:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216704:0@lo:256: 00000100:00100000:2.0:1789023913.364666:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.367748:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.367975:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216704 00000100:00100000:3.0:1789023913.367987:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216704 00000100:00100000:3.0:1789023913.368047:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789023913.368058:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000275b25d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:6512:x1875927422216704:12345-0@lo:256: 20000000:01000000:3.0:1789023913.368086:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023913.368115:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023913.368118:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789023913.368308:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000275b25d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:6512:x1875927422216704:12345-0@lo:256: Request processed in 252us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.368317:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023913.368872:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216704:0@lo:256: 10000000:01000000:2.0:1789023913.368943:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789023913.368965:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.368977:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 0000000068e0af17/0xa736ef4b98cb3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023913.368991:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023913.368994:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc199e6000 from 21 10000000:01000000:2.0:1789023913.368997:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023913.369044:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.369065:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.369075:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.369097:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216832:0@lo:101: 00000100:00100000:2.0:1789023913.369140:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.369208:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.369499:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216832 00000100:00100000:3.0:1789023913.369513:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216832 00000100:00100000:3.0:1789023913.369557:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789023913.369564:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085c51874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:6512:x1875927422216832:12345-0@lo:101: 00010000:00010000:3.0:1789023913.369578:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023913.369716:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3f14828/0xa736ef4b98cb3325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb331e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.369744:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f14828/0xa736ef4b98cb3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.369755:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3f14828/0xa736ef4b98cb3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.369765:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3f14828, rc 0) 00000100:00100000:3.0:1789023913.369814:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085c51874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422216832:12345-0@lo:101: Request processed in 250us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.369820:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023913.375513:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216832:0@lo:101: 00010000:00010000:2.0:1789023913.375563:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.375579:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.375711:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216960:0@lo:501: 00000100:00100000:2.0:1789023913.375784:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.375852:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.376203:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422216960 00000100:00100000:3.0:1789023913.376212:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422216960 00000100:00100000:3.0:1789023913.376273:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789023913.376282:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f9283526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422216960:12345-0@lo:501: 00000100:00100000:3.0:1789023913.376458:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f9283526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422216960:12345-0@lo:501: Request processed in 177us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.376465:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789023913.376787:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422216960:0@lo:501: 00000100:00100000:2.0:1789023913.376827:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217088:0@lo:503: 00000100:00100000:2.0:1789023913.376895:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.376918:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.377131:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217088 00000100:00100000:3.0:1789023913.377136:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217088 00000100:00100000:3.0:1789023913.377210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789023913.377217:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089c2ecc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422217088:12345-0@lo:503: 00000100:00100000:3.0:1789023913.377378:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089c2ecc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422217088:12345-0@lo:503: Request processed in 161us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.377392:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789023913.377712:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217088:0@lo:503: 00000100:00100000:2.0:1789023913.381375:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7818:1875927422217216:0@lo:502: 00000100:00100000:2.0:1789023913.381512:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.381588:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.381888:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217216 00000100:00100000:3.0:1789023913.381898:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217216 00000100:00100000:1.0:1789023913.382139:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789023913.382171:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056bcd398 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:7818:x1875927422217216:12345-0@lo:502: 00000100:00100000:1.0:1789023913.382350:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056bcd398 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:7818:x1875927422217216:12345-0@lo:502: Request processed in 182us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.382358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789023913.382559:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7818:1875927422217216:0@lo:502: 00000100:00100000:2.0:1789023913.382680:0:7818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7818:1875927422217344:0@lo:502: 00000100:00100000:2.0:1789023913.382720:0:7818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.382754:0:7818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.382817:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217344 00000100:00100000:0.0:1789023913.382822:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217344 00000100:00100000:0.0:1789023913.382866:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789023913.382873:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a53d9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:7818:x1875927422217344:12345-0@lo:502: 00000100:00100000:0.0:1789023913.382968:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a53d9fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:7818:x1875927422217344:12345-0@lo:502: Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.382974:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789023913.383525:0:7818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7818:1875927422217344:0@lo:502: 00000040:00080000:2.0:1789023913.383562:0:7818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789023913.383820:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789023913.383851:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023913.383862:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023913.383874:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000006f9c5c9c/0xa736ef4b98cb331e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023913.383886:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789023913.383889:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc199e6000 from 4 10000000:01000000:0.0:1789023913.383893:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789023913.383926:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023913.383943:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023913.384018:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023913.384100:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a48ae021 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217472:0@lo:101: 00000100:00100000:0.0:1789023913.384180:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.384270:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035256485 going to sleep for 11 seconds 00000100:00100000:3.0:1789023913.389789:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217472 00000100:00100000:3.0:1789023913.389810:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217472 00000100:00100000:3.0:1789023913.389900:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789023913.389911:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004ce0a652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422217472:12345-0@lo:101: 00010000:00010000:3.0:1789023913.389934:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023913.390116:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f6ee664/0xa736ef4b98cb3333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb332c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.390177:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f6ee664/0xa736ef4b98cb3333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.390190:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f6ee664/0xa736ef4b98cb3333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023913.390200:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f6ee664, rc 0) 00000100:00100000:3.0:1789023913.390463:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004ce0a652 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422217472:12345-0@lo:101: Request processed in 553us (6282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023913.390471:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789023913.390705:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a48ae021 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217472:0@lo:101: 00010000:00010000:2.0:1789023913.390727:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.390738:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.390824:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217600:0@lo:256: 00000100:00100000:2.0:1789023913.390884:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.390929:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:1.0:1789023913.391058:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217600 00000100:00100000:1.0:1789023913.391065:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217600 00000100:00100000:1.0:1789023913.391108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789023913.391115:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000445dbc37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422217600:12345-0@lo:256: 20000000:01000000:1.0:1789023913.391133:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789023913.391180:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789023913.391183:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789023913.391279:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000445dbc37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422217600:12345-0@lo:256: Request processed in 165us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.391286:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789023913.391501:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217600:0@lo:256: 10000000:01000000:2.0:1789023913.391566:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789023913.391573:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.391590:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000009adaff49/0xa736ef4b98cb332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023913.391619:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789023913.391621:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789023913.391624:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023913.391664:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.391671:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.391680:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.391692:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217728:0@lo:101: 00000100:00100000:2.0:1789023913.391720:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.391749:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:1.0:1789023913.391944:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217728 00000100:00100000:1.0:1789023913.391959:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217728 00000100:00100000:1.0:1789023913.391991:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789023913.391998:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d344320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422217728:12345-0@lo:101: 00010000:00010000:1.0:1789023913.392007:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023913.392024:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c274c4bc/0xa736ef4b98cb3341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb333a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023913.392184:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c274c4bc/0xa736ef4b98cb3341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023913.392194:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c274c4bc/0xa736ef4b98cb3341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023913.392202:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c274c4bc, rc 0) 00000100:00100000:1.0:1789023913.392316:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d344320 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422217728:12345-0@lo:101: Request processed in 319us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.392323:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789023913.392414:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217728:0@lo:101: 00010000:00010000:2.0:1789023913.392426:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.392434:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.392497:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217856:0@lo:501: 00000100:00100000:2.0:1789023913.392523:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.392553:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.393376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217856 00000100:00100000:0.0:1789023913.393384:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217856 00000100:00100000:0.0:1789023913.393429:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789023913.393437:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ca290e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422217856:12345-0@lo:501: 00000100:00100000:0.0:1789023913.393716:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ca290e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422217856:12345-0@lo:501: Request processed in 279us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.393724:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789023913.394390:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217856:0@lo:501: 00000100:00100000:2.0:1789023913.394439:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217984:0@lo:503: 00000100:00100000:2.0:1789023913.394500:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.394525:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000097c671c going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.395333:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422217984 00000100:00100000:0.0:1789023913.395343:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422217984 00000100:00100000:0.0:1789023913.395391:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789023913.395397:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c41c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422217984:12345-0@lo:503: 00000100:00100000:0.0:1789023913.395523:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c41c0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422217984:12345-0@lo:503: Request processed in 126us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.395529:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789023913.395820:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cebe79b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422217984:0@lo:503: 00000100:00100000:3.0:1789023913.407569:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1574e3d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7819:1875927422218112:0@lo:502: 00000100:00100000:3.0:1789023913.407713:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023913.407768:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f1e3df6 going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.408067:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218112 00000100:00100000:2.0:1789023913.408077:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218112 00000100:00100000:2.0:1789023913.408127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789023913.408136:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083bbb7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:7819:x1875927422218112:12345-0@lo:502: 00000100:00100000:2.0:1789023913.408511:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083bbb7e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:7819:x1875927422218112:12345-0@lo:502: Request processed in 375us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023913.408519:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789023913.408805:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1574e3d pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7819:1875927422218112:0@lo:502: 00000020:01000000:3.0:1789023913.408888:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023913.408903:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023913.408906:0:7819:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789023913.408922:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789023913.408926:0:7819:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:00000080:3.0:1789023913.409024:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789023913.409106:0:7819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000d1267200) 00000020:00000080:3.0:1789023913.409135:0:7819:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789023913.409142:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789023913.409416:0:7819:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789023913.409422:0:7819:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789023913.409432:0:7819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb334f 00010000:00080000:3.0:1789023913.409466:0:7819:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f49efa7@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:3.0:1789023913.423481:0:7819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789023913.436132:0:7819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023913.436403:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789023913.436467:0:7819:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789023913.436500:0:7819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb3356 00000100:00080000:0.0:1789023913.436521:0:7819:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023913.436535:0:7819:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000002f49efa7 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789023913.436762:0:7819:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfcfb697 x1875927422218240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023913.436795:0:7819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789023913.436897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfcfb697 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422218240:0@lo:38: 00000100:00100000:2.0:1789023913.436986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.437075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218240 00000100:00100000:2.0:1789023913.437084:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218240 00000100:00100000:2.0:1789023913.437120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789023913.437127:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cebe79b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422218240:12345-0@lo:38: 00010000:00080000:2.0:1789023913.437182:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1789023913.437234:0:6520:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb335d 00000004:00100000:2.0:1789023913.437250:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789023913.437258:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:01000000:0.0:1789023913.437556:0:7819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:01000000:0.0:1789023913.437890:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023913.437897:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023913.437899:0:7819:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789023913.437903:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023913.437907:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023913.437909:0:7819:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789023913.437912:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789023913.437913:0:7819:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789023913.437946:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5dd56c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7819:1875927422218368:0@lo:502: 00000100:00100000:0.0:1789023913.438016:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.438058:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001e68177 going to sleep for 11 seconds 00000100:00080000:0.0:1789023913.438125:0:7822:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000042f3858d x1875927422218496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023913.438134:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcaeae79 going to sleep for 0 seconds 00000100:00100000:0.0:1789023913.438196:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218368 00000100:00100000:0.0:1789023913.438201:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218368 00000100:00100000:0.0:1789023913.438239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023913.438246:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003615c70d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:7819:x1875927422218368:12345-0@lo:502: 00000100:00100000:0.0:1789023913.438374:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003615c70d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:7819:x1875927422218368:12345-0@lo:502: Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.438382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023913.438442:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5dd56c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:7819:1875927422218368:0@lo:502: 00000020:01000000:0.0:1789023913.438477:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023913.438481:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023913.438482:0:7819:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789023913.438485:0:7819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789023913.441975:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789023913.442024:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789023913.442045:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442061:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 00000000027f63c3/0xa736ef4b98cb333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023913.442098:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789023913.442101:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cc339999c0 from 1 10000000:01000000:2.0:1789023913.442105:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789023913.442171:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442205:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442229:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.442256:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422218624:0@lo:101: 00000100:00100000:2.0:1789023913.442349:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.442403:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218624 00000100:00100000:2.0:1789023913.442410:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218624 00000100:00100000:2.0:1789023913.442460:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789023913.442470:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe7a90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422218624:12345-0@lo:101: 00010000:00010000:2.0:1789023913.442485:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023913.442500:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f5731b2/0xa736ef4b98cb336b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3364 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442526:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f5731b2/0xa736ef4b98cb336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442550:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f5731b2/0xa736ef4b98cb336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442558:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f5731b2, rc 0) 00000100:00100000:2.0:1789023913.442614:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe7a90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422218624:12345-0@lo:101: Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023913.442621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789023913.442669:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.442692:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422218624:0@lo:101: 00010000:00010000:2.0:1789023913.442707:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.442716:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023913.442775:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422218752:0@lo:501: 00000100:00100000:2.0:1789023913.442798:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.442811:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cddc75ac going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.442824:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218752 00000100:00100000:2.0:1789023913.442828:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218752 00000100:00100000:2.0:1789023913.442852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789023913.442857:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017b20cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422218752:12345-0@lo:501: 00000100:00100000:2.0:1789023913.442935:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017b20cb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422218752:12345-0@lo:501: Request processed in 78us (135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023913.442942:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789023913.442971:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422218752:0@lo:501: 10000000:01000000:2.0:1789023913.442990:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789023913.442993:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023913.443000:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: 000000005ee6e809/0xa736ef4b98cb3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023913.447810:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422218880:0@lo:400: 00000100:00100000:3.0:1789023913.447894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.448737:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007baee0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422219008:0@lo:400: 00000100:00100000:2.0:1789023913.448777:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023913.448846:0:6521:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789023913.448856:0:6521:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789023913.448896:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422219136:0@lo:400: 00000100:00100000:2.0:1789023913.448959:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789023913.449266:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000aad940d0 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023913.449382:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cebe79b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422218240:12345-0@lo:38: Request processed in 12252us (12394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.449395:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023913.449429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219008 00000100:00100000:1.0:1789023913.449438:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219008 00000100:00100000:1.0:1789023913.449474:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023913.449481:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea989a89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422219008:12345-0@lo:400: 00000100:00100000:1.0:1789023913.449529:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea989a89 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422219008:12345-0@lo:400: Request processed in 49us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.449794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023913.449819:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218880 00000100:00100000:1.0:1789023913.449823:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218880 00000100:00100000:1.0:1789023913.450090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219136 00000100:00100000:1.0:1789023913.450095:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219136 00000100:00100000:0.0:1789023913.450128:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023913.450139:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1574e3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422218880:12345-0@lo:400: 00000100:00100000:2.0:1789023913.450225:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023913.450239:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789023913.450248:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789023913.450255:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789023913.450258:0:3640:0:(import.c:65:import_set_state_nolock()) 000000002f49efa7 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789023913.450276:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fcaeae79): req@0000000042f3858d x1875927422218496/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023913.450292:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfcfb697 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422218240:0@lo:38: 00000100:00100000:1.0:1789023913.450358:0:6517:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789023913.450368:0:6517:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789023913.450425:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007baee0f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422219008:0@lo:400: 00000100:00100000:1.0:1789023913.450530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023913.450549:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000547b597c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422219136:12345-0@lo:400: 00000100:00100000:1.0:1789023913.450608:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000547b597c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422219136:12345-0@lo:400: Request processed in 73us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023913.450615:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789023913.450651:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008f0b36f4 x1875927422219136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023913.450663:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f0b36f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422219136:0@lo:400: 00000100:00100000:0.0:1789023913.451333:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1574e3d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422218880:12345-0@lo:400: Request processed in 1194us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.451343:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023913.451382:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057385add pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422219264:0@lo:41: 00000100:00100000:0.0:1789023913.451437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.451485:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219264 00000100:00100000:0.0:1789023913.451491:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219264 00000100:00100000:0.0:1789023913.451525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023913.451716:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023913.451728:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcaeae79 going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.451762:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5dd56c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422219264:12345-0@lo:41: 00000004:00000024:0.0:1789023913.451796:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789023913.451930:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5dd56c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422219264:12345-0@lo:41: Request processed in 398us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.451937:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789023913.451950:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422218496 00000100:00100000:0.0:1789023913.451953:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422218496 00000100:00100000:0.0:1789023913.451967:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023913.451972:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000017c4e193 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422218496:12345-0@lo:1000: 00000100:00100000:0.0:1789023913.452052:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000017c4e193 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422218496:12345-0@lo:1000: Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.452059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023913.452092:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422218496:0@lo:1000: 00000040:01000000:0.0:1789023913.452165:0:7822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789023913.452210:0:7822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219392:0@lo:1000: 00000100:00100000:0.0:1789023913.452256:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.452275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219392 00000100:00100000:0.0:1789023913.452279:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219392 00000100:00100000:0.0:1789023913.452301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789023913.452306:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034f14257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219392:12345-0@lo:1000: 00000100:00100000:0.0:1789023913.452404:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034f14257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219392:12345-0@lo:1000: Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.452411:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789023913.452426:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcaeae79 going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.452437:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219392:0@lo:1000: 00000100:00100000:0.0:1789023913.452474:0:7822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219520:0@lo:700: 00000100:00100000:0.0:1789023913.452496:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.452519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219520 00000100:00100000:0.0:1789023913.452522:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219520 00000100:00100000:0.0:1789023913.452562:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023913.452568:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bfcfb697 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219520:12345-0@lo:700: 00000100:00100000:0.0:1789023913.452627:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bfcfb697 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219520:12345-0@lo:700: Request processed in 59us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023913.452633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023913.452654:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035702603 going to sleep for 11 seconds 00000100:00100000:0.0:1789023913.452665:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219520:0@lo:700: 00000100:00100000:0.0:1789023913.452848:0:7822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219648:0@lo:1000: 00000100:00100000:0.0:1789023913.452874:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.452896:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dae807e5 going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.453036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219648 00000100:00100000:2.0:1789023913.453051:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219648 00000100:00100000:2.0:1789023913.453104:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023913.453112:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a48ae021 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219648:12345-0@lo:1000: 00000100:00100000:2.0:1789023913.453291:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a48ae021 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219648:12345-0@lo:1000: Request processed in 179us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023913.453298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023913.453370:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219648:0@lo:1000: 00000004:00080000:0.0:1789023913.453419:0:7822:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000035702603 with version 0 00000020:00100000:0.0:1789023913.453436:0:7822:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789023913.453444:0:7822:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000042f3858d x1875927422219904/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789023913.453457:0:7822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219904:0@lo:1000: 00000100:00100000:0.0:1789023913.453486:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.453573:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000001e68177 going to sleep for 11 seconds 00000100:00100000:1.0:1789023913.453737:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057385add pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422219264:0@lo:41: 00000100:00100000:2.0:1789023913.453784:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422219904 00000100:00100000:2.0:1789023913.453790:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422219904 00000100:00100000:2.0:1789023913.453827:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023913.453834:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2e395be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7822:x1875927422219904:12345-0@lo:1000: 00010000:00080000:3.0:1789023913.454497:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d9187371 x1875927422218880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023913.454516:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9187371 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422218880:0@lo:400: 00000001:00080000:3.0:1789023913.461996:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789023913.462012:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789023913.462355:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2e395be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7822:x1875927422219904:12345-0@lo:1000: Request processed in 8511us (8858us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789023913.462376:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789023913.463588:0:7822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789023913.463605:0:7822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789023913.463626:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042f3858d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422219904:0@lo:1000: 00000100:00100000:1.0:1789023913.463755:0:7822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f001ba4e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422220032:0@lo:1000: 00000100:00100000:1.0:1789023913.463824:0:7822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023913.463863:0:7822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d32d8b going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.464330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220032 00000100:00100000:2.0:1789023913.464339:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220032 00000100:00100000:2.0:1789023913.464395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789023913.464403:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054a2d9f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7822:x1875927422220032:12345-0@lo:1000: 00000100:00100000:2.0:1789023913.464515:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054a2d9f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7822:x1875927422220032:12345-0@lo:1000: Request processed in 113us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023913.464523:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789023913.464761:0:7822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f001ba4e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7822:1875927422220032:0@lo:1000: 00000040:00080000:1.0:1789023913.464787:0:7822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789023913.464833:0:7822:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000088e3fde with version 1 00000004:00080000:0.0:1789023913.465697:0:7820:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000003e9216b6 version 1 rpc_version 1 00000020:00100000:0.0:1789023913.465738:0:7820:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789023913.465748:0:7820:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ef83ccfe x1875927422220288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789023913.465772:0:7820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7820:1875927422220288:0@lo:1000: 00000100:00100000:0.0:1789023913.465847:0:7820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023913.465881:0:7820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7253485 going to sleep for 11 seconds 00000100:00100000:2.0:1789023913.466123:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220288 00000100:00100000:2.0:1789023913.466132:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220288 00000100:00100000:2.0:1789023913.466202:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789023913.466211:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2a00be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7820:x1875927422220288:12345-0@lo:1000: 00000040:00080000:1.0:1789023913.471009:0:7822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789023913.471832:0:7822:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789023913.473117:0:7822:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789023913.479754:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789023913.480057:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2a00be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7820:x1875927422220288:12345-0@lo:1000: Request processed in 13841us (14215us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789023913.480073:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1789023913.480263:0:7820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789023913.480270:0:7820:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789023913.480292:0:7820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7820:1875927422220288:0@lo:1000: 00010000:00010000:1.0:1789023913.804407:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789023914.631605:0:7875:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789023914.631822:0:7875:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789023914.831108:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789023915.715809:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd63f69d30 20000000:00000080:2.0:1789023915.715831:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cc3469e400 uarg=0000000000000000 20000000:01000000:2.0:1789023915.715896:0:7923:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789023915.715905:0:7923:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789023915.715911:0:7923:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789023915.716003:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789023915.716017:0:7923:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789023915.723217:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023915.723501:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789023915.723533:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789023915.723548:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789023915.723568:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789023915.723602:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723635:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723642:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723648:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723694:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723710:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 17 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023915.723725:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77ac38d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875927422220416:0@lo:104: 00000100:00100000:2.0:1789023915.723811:0:7923:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023915.723875:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.723883:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 17 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023915.723891:0:7923:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000364b5de7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875927422220544:0@lo:104: 00000100:00100000:2.0:1789023915.723911:0:7923:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a82b3b90 going to sleep for 11 seconds 00000100:00100000:1.0:1789023915.724230:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789023915.724252:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023915.724280:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220416 00000100:00100000:1.0:1789023915.724288:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220416 00000100:00100000:1.0:1789023915.724328:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220544 00000100:00100000:1.0:1789023915.724331:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220544 00000100:00100000:1.0:1789023915.724345:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023915.724352:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000013fd1a4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:7923:x1875927422220416:12345-0@lo:104: 00010000:00010000:1.0:1789023915.724365:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724419:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023915.724424:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000013fd1a4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:7923:x1875927422220416:12345-0@lo:104: Request processed in 73us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023915.724430:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023915.724469:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023915.724473:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f001ba4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:7923:x1875927422220544:12345-0@lo:104: 00010000:00010000:1.0:1789023915.724479:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724508:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789023915.724513:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f001ba4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:7923:x1875927422220544:12345-0@lo:104: Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023915.724518:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789023915.724549:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023915.724554:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724586:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eaa4e43b already unused, calling callback (00000000ca6079bc) 10000000:00010000:1.0:1789023915.724591:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724599:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023915.724605:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023915.724611:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023915.724642:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724648:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023915.724666:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724672:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 00000000eaa4e43b/0xa736ef4b98cb32d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32df expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724687:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023915.724689:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724695:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ef6dd8d already unused, calling callback (00000000ca6079bc) 10000000:00010000:1.0:1789023915.724696:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724711:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023915.724716:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023915.724721:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023915.724732:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724737:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023915.724749:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724755:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: 000000008ef6dd8d/0xa736ef4b98cb31ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb31f1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.724769:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023915.724771:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023915.724772:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023915.724790:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023915.724806:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023915.724818:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f525211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422220672:0@lo:103: 00000100:00100000:1.0:1789023915.724850:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023915.724885:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b8b7798 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422220800:0@lo:103: 00000100:00100000:1.0:1789023915.724906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023915.724955:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220672 00000100:00100000:1.0:1789023915.724959:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220672 00010000:00010000:1.0:1789023915.724977:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 18 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023915.725003:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220800 00000100:00100000:1.0:1789023915.725006:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220800 00010000:00010000:1.0:1789023915.725019:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 19 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023915.725031:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023915.725036:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ccf95195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+19:3643:x1875927422220672:12345-0@lo:103: 00010000:00010000:1.0:1789023915.725046:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023915.725052:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 19 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023915.725061:0:6500:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789023915.725061:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 19 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023915.725070:0:6500:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789023915.725077:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023915.725103:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ccf95195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+19:3643:x1875927422220672:12345-0@lo:103: Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023915.725109:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023915.725121:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023915.725125:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009aaf1468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+18:3641:x1875927422220800:12345-0@lo:103: 00010000:00010000:1.0:1789023915.725133:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023915.725136:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 18 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725143:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 18 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725173:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725185:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725198:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725205:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725210:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725216:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725220:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008187da5c already unused, calling callback (00000000af7802da) 00010000:00010000:1.0:1789023915.725224:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725230:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725238:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023915.725247:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023915.725272:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009aaf1468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+18:3641:x1875927422220800:12345-0@lo:103: Request processed in 147us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023915.725280:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023915.725316:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b8b7798 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422220800:0@lo:103: 00000100:00100000:1.0:1789023915.725347:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f525211d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422220672:0@lo:103: 00010000:00010000:2.0:1789023915.726881:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3520af9/0xa736ef4b98cb32df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb32d8 expref: 17 pid: 6508 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023915.726900:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77ac38d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875927422220416:0@lo:104: 00010000:00010000:2.0:1789023915.726995:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000403aceec/0xa736ef4b98cb31f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb31ea expref: 16 pid: 6509 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023915.727008:0:7923:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000364b5de7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875927422220544:0@lo:104: 00010000:00010000:2.0:1789023915.727031:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.727041:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.727046:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023915.727052:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008187da5c/0xa736ef4b98cb3372 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023915.854223:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023916.429882:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000364b5de7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422220928:0@lo:41: 00000100:00100000:1.0:1789023916.429982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023916.430315:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422220928 00000100:00100000:0.0:1789023916.430326:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422220928 00000100:00100000:0.0:1789023916.430536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023916.430561:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f525211d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422220928:12345-0@lo:41: 00000004:00000024:0.0:1789023916.430616:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789023916.430678:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f525211d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422220928:12345-0@lo:41: Request processed in 119us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023916.430685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789023916.430779:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000364b5de7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422220928:0@lo:41: 00010000:00010000:0.0:1789023916.876433:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023917.904216:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023918.476521:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d7b44427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422221184:0@lo:400: 00000100:00100000:3.0:1789023918.476658:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b8b7798 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422221056:0@lo:400: 00000100:00100000:3.0:1789023918.476751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023918.476814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f9b3e4ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422221568:0@lo:400: 00000100:00100000:3.0:1789023918.476873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023918.477097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023918.477164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062bc016d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422221312:0@lo:400: 00000100:00100000:1.0:1789023918.477192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023918.477213:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023918.477219:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff0fee3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422221440:0@lo:400: 00000100:00100000:1.0:1789023918.477241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023918.477277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221568 00000100:00100000:1.0:1789023918.477285:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221568 00000100:00100000:1.0:1789023918.477336:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221312 00000100:00100000:1.0:1789023918.477339:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221312 00000100:00100000:1.0:1789023918.477358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023918.477366:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f581ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422221568:12345-0@lo:400: 00000100:00100000:3.0:1789023918.477472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221184 00000100:00100000:3.0:1789023918.477476:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221184 00000100:00100000:3.0:1789023918.477512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221440 00000100:00100000:3.0:1789023918.477516:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221440 00000100:00100000:3.0:1789023918.477546:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023918.477565:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008fd1150f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422221184:12345-0@lo:400: 00000100:00100000:3.0:1789023918.477621:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008fd1150f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422221184:12345-0@lo:400: Request processed in 58us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023918.477629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023918.477646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023918.477652:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de86ff25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422221440:12345-0@lo:400: 00000100:00100000:3.0:1789023918.477682:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de86ff25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422221440:12345-0@lo:400: Request processed in 31us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023918.477688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023918.477846:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f581ff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422221568:12345-0@lo:400: Request processed in 481us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023918.477854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023918.477868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023918.477874:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b1a9f93 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422221312:12345-0@lo:400: 00000100:00100000:2.0:1789023918.478037:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221056 00000100:00100000:2.0:1789023918.478042:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221056 00000100:00100000:2.0:1789023918.478073:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789023918.478078:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000681ffd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:3643:x1875927422221056:12345-0@lo:400: 00000100:00100000:2.0:1789023918.478111:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000681ffd6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:3643:x1875927422221056:12345-0@lo:400: Request processed in 34us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023918.478117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023918.478251:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b1a9f93 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422221312:12345-0@lo:400: Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023918.478258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789023918.478311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ff0fee3c x1875927422221440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023918.478327:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff0fee3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422221440:0@lo:400: 00000100:00100000:1.0:1789023918.478335:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062bc016d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422221312:0@lo:400: 00000100:00100000:1.0:1789023918.478361:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a77ac38d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422221696:0@lo:41: 00000100:00100000:3.0:1789023918.478479:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b8b7798 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422221056:0@lo:400: 00000100:00100000:3.0:1789023918.478489:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f9b3e4ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422221568:0@lo:400: 00000100:00100000:1.0:1789023918.478645:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789023918.480704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d7b44427 x1875927422221184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023918.480727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7b44427 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422221184:0@lo:400: 00000100:00100000:2.0:1789023918.486400:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221696 00000100:00100000:2.0:1789023918.486423:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221696 00000100:00100000:3.0:1789023918.486652:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023918.486664:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000062bc016d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422221696:12345-0@lo:41: 00000004:00000024:3.0:1789023918.486714:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789023918.486843:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000062bc016d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422221696:12345-0@lo:41: Request processed in 181us (8198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023918.486851:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023918.487061:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a77ac38d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422221696:0@lo:41: 00010000:00010000:3.0:1789023918.933380:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023919.954810:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023920.972458:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023921.043398:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023921.043405:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc414b7800 from 1 10000000:01000000:2.0:1789023921.043410:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023921.043459:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: 000000008187da5c/0xa736ef4b98cb3379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.043491:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: 000000008187da5c/0xa736ef4b98cb3379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.043504:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: 000000008187da5c/0xa736ef4b98cb3379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023921.044094:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed5c9a3d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422221824:0@lo:101: 00000100:00100000:2.0:1789023921.044240:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023921.044298:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe1ad5e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789023921.044470:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221824 00000100:00100000:3.0:1789023921.044479:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221824 00000100:00100000:3.0:1789023921.044614:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789023921.044624:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000061064eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422221824:12345-0@lo:101: 00010000:00010000:3.0:1789023921.044640:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023921.044654:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efeb71b1/0xa736ef4b98cb3380 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3379 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023921.044689:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efeb71b1/0xa736ef4b98cb3380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023921.044699:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efeb71b1/0xa736ef4b98cb3380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023921.044708:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efeb71b1, rc 0) 00000100:00100000:3.0:1789023921.044754:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000061064eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422221824:12345-0@lo:101: Request processed in 131us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023921.044761:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789023921.046404:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed5c9a3d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422221824:0@lo:101: 00010000:00010000:2.0:1789023921.046434:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: 000000008187da5c/0xa736ef4b98cb3379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.046445:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: 000000008187da5c/0xa736ef4b98cb3379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023921.046635:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed5c9a3d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422221952:0@lo:501: 00000100:00100000:2.0:1789023921.046693:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023921.046734:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe1ad5e5 going to sleep for 11 seconds 00000100:00100000:0.0:1789023921.047134:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422221952 00000100:00100000:0.0:1789023921.047142:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422221952 00000100:00100000:0.0:1789023921.047205:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023921.047215:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059eaf64c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422221952:12345-0@lo:501: 00000100:00100000:0.0:1789023921.047349:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059eaf64c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422221952:12345-0@lo:501: Request processed in 134us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.047356:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023921.047394:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed5c9a3d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422221952:0@lo:501: 00000100:00100000:0.0:1789023921.047426:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222080:0@lo:503: 00000100:00100000:0.0:1789023921.047465:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.047484:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ca33be2 going to sleep for 11 seconds 00000100:00100000:0.0:1789023921.047495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222080 00000100:00100000:0.0:1789023921.047499:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222080 00000100:00100000:0.0:1789023921.047519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789023921.047606:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008aca7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422222080:12345-0@lo:503: 00000100:00100000:0.0:1789023921.047686:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008aca7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422222080:12345-0@lo:503: Request processed in 160us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.047692:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789023921.047732:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222080:0@lo:503: 00000100:00100000:0.0:1789023921.048426:0:8151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8151:1875927422222208:0@lo:502: 00000100:00100000:0.0:1789023921.048467:0:8151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.048496:0:8151:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4e9cc4a going to sleep for 11 seconds 00000100:00100000:2.0:1789023921.048545:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222208 00000100:00100000:2.0:1789023921.048552:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222208 00000100:00100000:2.0:1789023921.048585:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789023921.048591:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008461c776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:8151:x1875927422222208:12345-0@lo:502: 00000100:00100000:2.0:1789023921.048671:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008461c776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:8151:x1875927422222208:12345-0@lo:502: Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023921.048677:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789023921.048813:0:8151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef83ccfe pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8151:1875927422222208:0@lo:502: 00000020:01000000:0.0:1789023921.048847:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023921.048857:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023921.048859:0:8151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789023921.048871:0:8151:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc414b7800 00000020:00000080:0.0:1789023921.048873:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023921.048918:0:8151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8151:1875927422222336:0@lo:502: 00000100:00100000:0.0:1789023921.048949:0:8151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.048970:0:8151:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023921.049111:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222336 00000100:00100000:2.0:1789023921.049116:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222336 00000100:00100000:2.0:1789023921.049171:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789023921.049180:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:8151:x1875927422222336:12345-0@lo:502: 00000100:00100000:2.0:1789023921.049241:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:8151:x1875927422222336:12345-0@lo:502: Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023921.049248:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789023921.049326:0:8151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8151:1875927422222336:0@lo:502: 00000020:01000000:0.0:1789023921.049343:0:8151:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023921.049347:0:8151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023921.049348:0:8151:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789023921.049353:0:8151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789023921.049477:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789023921.049501:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023921.049511:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.049535:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023921.049546:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023921.049548:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc199e6000 from 1 10000000:01000000:2.0:1789023921.049551:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023921.049574:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.049580:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023921.049589:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023921.049599:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222464:0@lo:101: 00000100:00100000:2.0:1789023921.049623:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023921.049647:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023921.049752:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222464 00000100:00100000:0.0:1789023921.049757:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222464 00000100:00100000:0.0:1789023921.049787:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023921.049794:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422222464:12345-0@lo:101: 00010000:00010000:0.0:1789023921.049803:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023921.049815:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3387 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023921.049849:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023921.049873:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023921.049892:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030800, rc 0) 00000100:00100000:0.0:1789023921.049923:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422222464:12345-0@lo:101: Request processed in 130us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.049929:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023921.049958:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222464:0@lo:101: 00010000:00010000:0.0:1789023921.049969:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023921.049978:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023921.050015:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222592:0@lo:501: 00000100:00100000:0.0:1789023921.050037:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.050050:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023921.050060:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222592 00000100:00100000:0.0:1789023921.050063:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222592 00000100:00100000:0.0:1789023921.050083:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789023921.050088:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422222592:12345-0@lo:501: 00000100:00100000:0.0:1789023921.050208:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422222592:12345-0@lo:501: Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.050213:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789023921.050240:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222592:0@lo:501: 00000100:00100000:0.0:1789023921.050262:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222720:0@lo:503: 00000100:00100000:0.0:1789023921.050297:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.050314:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023921.050324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222720 00000100:00100000:0.0:1789023921.050328:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222720 00000100:00100000:0.0:1789023921.050346:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023921.050351:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422222720:12345-0@lo:503: 00000100:00100000:0.0:1789023921.050413:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422222720:12345-0@lo:503: Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.050419:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023921.050452:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422222720:0@lo:503: 00000100:00100000:0.0:1789023921.051353:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8152:1875927422222848:0@lo:502: 00000100:00100000:0.0:1789023921.051394:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.051453:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023921.051485:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222848 00000100:00100000:2.0:1789023921.051491:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222848 00000100:00100000:2.0:1789023921.051626:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789023921.051636:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:8152:x1875927422222848:12345-0@lo:502: 00000100:00100000:2.0:1789023921.051734:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:8152:x1875927422222848:12345-0@lo:502: Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023921.051741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789023921.051817:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8152:1875927422222848:0@lo:502: 00000020:01000000:1.0:1789023921.051846:0:8152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023921.051855:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023921.051858:0:8152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789023921.051864:0:8152:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc199e6000 00000020:00000080:1.0:1789023921.051867:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789023921.051900:0:8152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8152:1875927422222976:0@lo:502: 00000100:00100000:1.0:1789023921.051935:0:8152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.052463:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422222976 00000100:00100000:0.0:1789023921.052469:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422222976 00000100:00100000:0.0:1789023921.052496:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789023921.052502:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:8152:x1875927422222976:12345-0@lo:502: 00000100:00100000:0.0:1789023921.052596:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:8152:x1875927422222976:12345-0@lo:502: Request processed in 93us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.052602:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789023921.052749:0:8152:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1042e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023921.052766:0:8152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8152:1875927422222976:0@lo:502: 00000020:01000000:3.0:1789023921.052788:0:8152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023921.052793:0:8152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023921.052795:0:8152:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789023921.052799:0:8152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789023921.053092:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789023921.053114:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023921.053125:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023921.053137:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023921.549030:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422223104:0@lo:41: 00000100:00100000:1.0:1789023921.549114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023921.550262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223104 00000100:00100000:0.0:1789023921.550276:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223104 00000100:00100000:0.0:1789023921.550341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023921.550352:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422223104:12345-0@lo:41: 00000004:00000024:0.0:1789023921.550402:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789023921.550477:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422223104:12345-0@lo:41: Request processed in 126us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023921.550500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023921.550606:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422223104:0@lo:41: 00010000:00010000:0.0:1789023921.999045:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023923.021377:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023923.597085:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023923.597112:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422223232:0@lo:41: 00000100:00100000:2.0:1789023923.597206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023923.597272:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223232 00000100:00100000:2.0:1789023923.597281:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223232 00000100:00100000:2.0:1789023923.597332:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023923.597341:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422223232:12345-0@lo:41: 00000004:00000024:2.0:1789023923.597374:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789023923.597421:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422223232:12345-0@lo:41: Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023923.597428:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023923.597477:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422223232:0@lo:41: 00000100:00100000:2.0:1789023923.599389:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422223360:0@lo:400: 00000100:00100000:2.0:1789023923.599451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023923.599489:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023923.599495:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422223488:0@lo:400: 00000100:00100000:2.0:1789023923.599533:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023923.599564:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223360 00000100:00100000:2.0:1789023923.599571:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223360 00000100:00100000:2.0:1789023923.599612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789023923.599629:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:3643:x1875927422223360:12345-0@lo:400: 00000100:00100000:2.0:1789023923.599679:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:3643:x1875927422223360:12345-0@lo:400: Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023923.599686:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789023923.599717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223488 00000100:00100000:2.0:1789023923.599721:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223488 00000100:00100000:2.0:1789023923.599748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789023923.599755:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422223488:12345-0@lo:400: 00000100:00100000:2.0:1789023923.599785:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422223488:12345-0@lo:400: Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023923.599791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789023923.599831:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3be9ce00 x1875927422223488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023923.599846:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422223488:0@lo:400: 00000100:00100000:2.0:1789023923.599855:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422223360:0@lo:400: 00000100:00100000:2.0:1789023923.599879:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422223616:0@lo:400: 00000100:00100000:2.0:1789023923.599905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023923.599926:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023923.599932:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422223744:0@lo:400: 00000100:00100000:2.0:1789023923.599949:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023923.599975:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223616 00000100:00100000:2.0:1789023923.599978:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223616 00000100:00100000:2.0:1789023923.600001:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023923.600007:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422223616:12345-0@lo:400: 00000100:00100000:2.0:1789023923.600041:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422223616:12345-0@lo:400: Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023923.600055:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023923.600073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223744 00000100:00100000:2.0:1789023923.600077:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223744 00000100:00100000:2.0:1789023923.600102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023923.600108:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422223744:12345-0@lo:400: 00000100:00100000:2.0:1789023923.600137:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422223744:12345-0@lo:400: Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023923.600142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789023923.600195:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3be9df80 x1875927422223744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023923.600204:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422223744:0@lo:400: 00000100:00100000:2.0:1789023923.600213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422223616:0@lo:400: 00010000:00010000:2.0:1789023924.044635:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023925.068291:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023926.092793:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789023926.598062:0:8424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789023926.598066:0:8424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789023926.598069:0:8424:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789023926.598246:0:8424:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cc3bd3a000 00000020:01000004:2.0:1789023926.598262:0:8424:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789023926.598277:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789023926.598300:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90cc35454d40) 00000020:00000080:2.0:1789023926.598319:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789023926.657010:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789023926.657083:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00000100:00100000:3.0:1789023926.668427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422223872:0@lo:41: 00000100:00100000:3.0:1789023926.668556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023926.668660:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422223872 00000100:00100000:0.0:1789023926.668678:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422223872 00000100:00100000:0.0:1789023926.668758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023926.668768:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422223872:12345-0@lo:41: 00000004:00000024:0.0:1789023926.668858:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789023926.668940:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422223872:12345-0@lo:41: Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023926.668947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023926.670390:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422223872:0@lo:41: 00080000:01000000:2.0:1789023926.734674:0:8424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789023926.735056:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789023926.735073:0:8424:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789023926.735088:0:8424:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa736ef4b98cb339c 00000020:01000004:2.0:1789023926.735098:0:8424:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789023926.735143:0:8424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789023926.735464:0:8424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789023926.735481:0:8424:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789023926.735488:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789023926.735506:0:8424:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90cc35453380) 00000020:00000080:2.0:1789023926.735520:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789023926.747532:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023926.753747:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023926.753758:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789023926.764649:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789023926.764681:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789023926.765568:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789023926.765579:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789023926.775693:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023926.776507:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789023926.776516:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789023926.778530:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789023926.778546:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789023926.830348:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023926.830733:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023926.830742:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789023926.832915:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789023926.832932:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789023926.834442:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789023926.834458:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789023926.838070:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023926.838390:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789023926.838398:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789023926.839864:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789023926.839879:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789023926.903072:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023926.903925:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789023926.903935:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789023926.907570:0:8424:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789023926.907602:0:8424:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789023926.908752:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789023926.908789:0:8424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789023926.908808:0:8424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789023926.996602:0:8424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789023926.996663:0:8424:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.118@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789023926.996668:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789023926.996670:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023926.996672:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023926.996673:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023926.996675:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023926.996676:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023926.996677:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023926.996679:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023926.996681:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023926.996682:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023926.996684:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789023926.996689:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789023926.996691:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789023926.996692:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023926.996693:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023926.996695:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023926.996695:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023926.996697:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023926.996703:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023926.996703:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023926.996704:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023926.996705:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023926.996706:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789023926.996741:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789023926.996766:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422224000:0@lo:253: 00000100:00100000:0.0:1789023926.997213:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023926.997283:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08a99600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023926.997531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224000 00000100:00100000:3.0:1789023926.997541:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224000 00000100:00100000:3.0:1789023926.997603:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789023926.997614:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:8424:x1875927422224000:12345-0@lo:253: 20000000:01000000:3.0:1789023926.997654:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789023926.997660:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789023926.997666:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789023926.997670:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789023926.998002:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023926.998215:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789023926.998231:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789023926.998421:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789023926.998430:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789023926.998450:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789023926.998478:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789023926.998587:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789023926.998607:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023926.998609:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023926.998625:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789023926.998630:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023926.998646:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789023926.998651:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023926.998676:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789023926.998684:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789023926.998697:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789023926.998732:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789023926.998809:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789023926.998820:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023926.998822:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023926.998836:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789023926.998842:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023926.998856:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789023926.998861:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023926.998874:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789023926.998880:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789023926.998894:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789023926.998909:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789023927.000693:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789023927.000727:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023927.000730:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023927.000748:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789023927.000754:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789023927.000767:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789023927.000773:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023927.000787:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789023927.001483:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789023927.001521:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789023927.001541:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789023927.001560:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789023927.001563:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789023927.001568:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789023927.001620:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023927.001624:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789023927.010293:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1789023927.010377:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1789023927.010397:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789023927.010809:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789023927.010839:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789023927.010859:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789023927.010875:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789023927.010878:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789023927.011767:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789023927.012040:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789023927.012079:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789023927.012096:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789023927.012108:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789023927.012111:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789023927.013034:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789023927.013083:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789023927.013112:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789023927.013609:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789023927.013633:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789023927.013647:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789023927.013662:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789023927.013665:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789023927.014317:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789023927.014350:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789023927.014365:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789023927.014649:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789023927.014670:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789023927.014685:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1789023927.014701:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789023927.014727:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014749:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014771:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014778:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014784:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014790:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014809:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014859:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.014878:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.014895:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224128:0@lo:104: 00000100:00100000:2.0:1789023927.015106:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023927.015369:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.015377:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 18 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.015387:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224256:0@lo:104: 00000100:00100000:2.0:1789023927.015419:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023927.015500:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.015508:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 18 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.015517:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224384:0@lo:104: 00000100:00100000:2.0:1789023927.015539:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023927.017710:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.017730:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 18 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.017745:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224512:0@lo:104: 00000100:00100000:2.0:1789023927.018031:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.018111:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224128 00000100:00100000:0.0:1789023927.018121:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224128 00000100:00100000:1.0:1789023927.018307:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224256 00000100:00100000:1.0:1789023927.018312:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224256 00000100:00100000:1.0:1789023927.018324:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224384 00000100:00100000:1.0:1789023927.018327:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224384 00000100:00100000:1.0:1789023927.018340:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023927.018350:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:6509:x1875927422224128:12345-0@lo:104: 00010000:00010000:1.0:1789023927.018368:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018440:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023927.018447:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:6509:x1875927422224128:12345-0@lo:104: Request processed in 98us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.018454:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023927.018483:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023927.018490:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422224256:12345-0@lo:104: 00010000:00010000:1.0:1789023927.018497:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018534:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789023927.018539:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422224256:12345-0@lo:104: Request processed in 51us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.018564:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023927.018578:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023927.018585:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422224384:12345-0@lo:104: 00010000:00010000:1.0:1789023927.018592:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018620:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789023927.018625:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422224384:12345-0@lo:104: Request processed in 42us (3086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.018630:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789023927.018648:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789023927.018656:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018664:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023927.018669:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018679:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023927.018687:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023927.018693:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023927.018726:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018733:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023927.018770:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018778:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb336b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018792:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023927.018808:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018813:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023927.018816:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018822:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023927.018827:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023927.018832:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023927.018845:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018850:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023927.018869:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018875:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb333a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3341 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.018883:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023927.018893:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.019176:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023927.019345:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023927.019351:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.019360:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023927.019367:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023927.019371:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023927.019403:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.019410:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023927.019418:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.019424:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c5c00/0xa736ef4b98cb331e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3325 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.019435:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023927.019437:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023927.019439:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023927.019457:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422224640:0@lo:103: 00000100:00100000:1.0:1789023927.019675:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.019738:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422224768:0@lo:103: 00000100:00100000:1.0:1789023927.019778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.019813:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023927.019820:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422224896:0@lo:103: 00000100:00100000:1.0:1789023927.019842:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.019879:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224640 00000100:00100000:1.0:1789023927.019886:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224640 00010000:00010000:1.0:1789023927.019915:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 19 pid: 6509 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.019941:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224768 00000100:00100000:1.0:1789023927.019944:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224768 00010000:00010000:1.0:1789023927.019968:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 20 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.019979:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224896 00000100:00100000:1.0:1789023927.019981:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224896 00010000:00010000:1.0:1789023927.020005:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 21 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.020023:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023927.020031:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422224640:12345-0@lo:103: 00010000:00010000:1.0:1789023927.020044:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023927.020050:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 21 pid: 6509 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020062:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 21 pid: 6509 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020083:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023927.020116:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422224640:12345-0@lo:103: Request processed in 86us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.020130:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023927.020178:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023927.020185:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+20:3641:x1875927422224768:12345-0@lo:103: 00010000:00010000:1.0:1789023927.020192:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023927.020197:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 20 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020204:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 20 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020214:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023927.020241:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+20:3641:x1875927422224768:12345-0@lo:103: Request processed in 57us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.020247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023927.020258:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023927.020264:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+19:3641:x1875927422224896:12345-0@lo:103: 00010000:00010000:1.0:1789023927.020270:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023927.020274:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 19 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020282:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 19 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.020291:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023927.020311:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+19:3641:x1875927422224896:12345-0@lo:103: Request processed in 48us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.020317:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023927.020360:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422224896:0@lo:103: 00000100:00100000:1.0:1789023927.020376:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422224768:0@lo:103: 00000100:00100000:1.0:1789023927.020407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422224640:0@lo:103: 00010000:00010000:2.0:1789023927.021029:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.021043:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 18 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.021056:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422225024:0@lo:104: 00000100:00100000:2.0:1789023927.021324:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023927.021345:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04c35300 going to sleep for 11 seconds 00010000:00010000:2.0:1789023927.021362:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb336b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3364 expref: 18 pid: 6509 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.021376:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224128:0@lo:104: 00010000:00010000:2.0:1789023927.021401:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb333a expref: 17 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.021409:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224256:0@lo:104: 00010000:00010000:2.0:1789023927.021416:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb331e expref: 16 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.021423:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224384:0@lo:104: 00000100:00100000:1.0:1789023927.023317:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422224512 00000100:00100000:1.0:1789023927.023336:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422224512 00000100:00100000:1.0:1789023927.023394:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225024 00000100:00100000:1.0:1789023927.023397:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225024 00000100:00100000:1.0:1789023927.023417:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023927.023427:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422224512:12345-0@lo:104: 00010000:00010000:1.0:1789023927.023447:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.023576:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023927.023584:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6509:x1875927422224512:12345-0@lo:104: Request processed in 159us (5553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.023591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023927.023609:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023927.023615:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422225024:12345-0@lo:104: 00010000:00010000:1.0:1789023927.023623:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.023661:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789023927.023666:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6509:x1875927422225024:12345-0@lo:104: Request processed in 52us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.023672:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789023927.023691:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023927.023697:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.023726:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023927.023731:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.023740:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023927.023748:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023927.023754:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789023927.024020:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422224512:0@lo:104: 00000100:00100000:2.0:1789023927.024037:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875927422225024:0@lo:104: 00010000:00010000:2.0:1789023927.024073:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024381:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024389:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023927.024413:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024421:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb32e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb32ed expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024437:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023927.024441:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024446:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023927.024449:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024481:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023927.024488:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023927.024493:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023927.024512:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024518:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023927.024524:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024531:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb326f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3276 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024546:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023927.024548:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023927.024550:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023927.024572:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422225152:0@lo:103: 00000100:00100000:1.0:1789023927.024626:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.024671:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023927.024677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422225280:0@lo:103: 00000100:00100000:1.0:1789023927.024701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.024729:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225152 00000100:00100000:1.0:1789023927.024735:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225152 00010000:00010000:1.0:1789023927.024758:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 16 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.024808:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225280 00000100:00100000:1.0:1789023927.024812:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225280 00010000:00010000:1.0:1789023927.024825:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 17 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.024843:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023927.024850:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+17:3643:x1875927422225152:12345-0@lo:103: 00010000:00010000:1.0:1789023927.024863:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023927.024868:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024879:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024893:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c5e00/0xa736ef4b98cb32ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb32e6 expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024906:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023927.024937:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+16:3643:x1875927422225152:12345-0@lo:103: Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.024943:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023927.024972:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023927.024978:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+15:3643:x1875927422225280:12345-0@lo:103: 00010000:00010000:1.0:1789023927.024986:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023927.024991:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 15 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.024999:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 15 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025015:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c5400/0xa736ef4b98cb3276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb326f expref: 15 pid: 6510 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025026:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025034:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025050:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025057:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025064:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025071:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025076:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789023927.025081:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025089:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025482:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.025504:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023927.025536:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f196050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+14:3643:x1875927422225280:12345-0@lo:103: Request processed in 559us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.025543:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023927.025614:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422225280:0@lo:103: 00000100:00100000:1.0:1789023927.025623:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422225152:0@lo:103: 00010000:00010000:0.0:1789023927.025723:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023927.025808:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.025817:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.025823:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023927.025838:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789023927.036073:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+13:8424:x1875927422224000:12345-0@lo:253: Request processed in 38444us (38844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023927.036241:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789023927.036445:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422224000:0@lo:253: 10000000:01000000:0.0:1789023927.036466:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789023927.036482:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023927.036484:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023927.036485:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023927.036487:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789023927.036488:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023927.036490:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023927.036491:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023927.036493:0:8424:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789023927.036495:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023927.036496:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789023927.036526:0:8424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cc3bd3a000 from lustre-OST0000 10000000:01000000:0.0:1789023927.036564:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789023927.036568:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789023927.036580:0:8424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cc339999c0 local copy 10000000:01000000:0.0:1789023927.036585:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789023927.036632:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.036662:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.036674:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023927.036696:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225408:0@lo:101: 00000100:00100000:0.0:1789023927.036745:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.037082:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08a99540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.037371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225408 00000100:00100000:2.0:1789023927.037380:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225408 00000100:00100000:2.0:1789023927.037485:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789023927.037497:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+13:8424:x1875927422225408:12345-0@lo:101: 00010000:00010000:2.0:1789023927.037514:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023927.037533:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb33b1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.037574:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb33b1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.037585:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33b1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.037596:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0800, rc 0) 00000100:00100000:2.0:1789023927.037658:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225408:12345-0@lo:101: Request processed in 164us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.037664:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789023927.037749:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225408:0@lo:101: 00010000:00010000:1.0:1789023927.037764:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.037774:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.038226:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225536:0@lo:501: 00000100:00100000:1.0:1789023927.038281:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.038664:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc074283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.038745:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225536 00000100:00100000:0.0:1789023927.038752:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225536 00000100:00100000:0.0:1789023927.038791:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789023927.038813:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225536:12345-0@lo:501: 00000100:00100000:0.0:1789023927.039172:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225536:12345-0@lo:501: Request processed in 360us (889us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023927.039181:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789023927.039399:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225536:0@lo:501: 10000000:01000000:1.0:1789023927.039423:0:8424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789023927.039451:0:8424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789023927.039459:0:8424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.039501:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.039509:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.039536:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789023927.039570:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cc3bd3a000 10000000:01000000:1.0:1789023927.039575:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789023927.039583:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789023927.039586:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023927.039591:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789023927.039594:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789023927.039622:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.039631:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.039641:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.039657:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225664:0@lo:101: 00000100:00100000:1.0:1789023927.039691:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.039714:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.039782:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225664 00000100:00100000:0.0:1789023927.039788:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225664 00000100:00100000:0.0:1789023927.040057:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789023927.040069:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225664:12345-0@lo:101: 00010000:00010000:0.0:1789023927.040081:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023927.040189:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb33bf expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040214:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040226:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040244:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030600, rc 0) 00000100:00100000:0.0:1789023927.040519:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422225664:12345-0@lo:101: Request processed in 450us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.040526:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1789023927.040558:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023927.040565:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040574:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023927.040578:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040588:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023927.040596:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023927.040602:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023927.040628:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040634:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023927.040668:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040675:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb33b8 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.040700:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023927.040702:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023927.040704:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023927.040713:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023927.040728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422225792:0@lo:103: 00000100:00100000:0.0:1789023927.040764:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.040897:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225792 00000100:00100000:0.0:1789023927.040904:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225792 00000100:00100000:0.0:1789023927.041033:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023927.041042:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+15:3642:x1875927422225792:12345-0@lo:103: 00010000:00010000:0.0:1789023927.041056:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023927.041071:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb33b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb33b1 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.041082:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023927.041218:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+14:3642:x1875927422225792:12345-0@lo:103: Request processed in 177us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.041225:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023927.041401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422225792:0@lo:103: 00000100:00100000:1.0:1789023927.042404:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225664:0@lo:101: 00010000:00010000:1.0:1789023927.042434:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.042487:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023927.042618:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225920:0@lo:501: 00000100:00100000:1.0:1789023927.042678:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.042773:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.043080:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422225920 00000100:00100000:2.0:1789023927.043088:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422225920 00000100:00100000:2.0:1789023927.043475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789023927.043488:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225920:12345-0@lo:501: 00000100:00100000:2.0:1789023927.043655:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422225920:12345-0@lo:501: Request processed in 169us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.043662:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789023927.043750:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422225920:0@lo:501: 00000100:00100000:1.0:1789023927.043788:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226048:0@lo:503: 00000100:00100000:1.0:1789023927.043865:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.044351:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.044499:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226048 00000100:00100000:0.0:1789023927.044506:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226048 00000100:00100000:0.0:1789023927.044543:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789023927.044552:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226048:12345-0@lo:503: 00000100:00100000:0.0:1789023927.044668:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226048:12345-0@lo:503: Request processed in 117us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.044676:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789023927.044777:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226048:0@lo:503: 00000040:00080000:1.0:1789023927.045483:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023927.047496:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226176:0@lo:502: 00000100:00100000:1.0:1789023927.047599:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.047685:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.047741:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226176 00000100:00100000:0.0:1789023927.047751:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226176 00000100:00100000:0.0:1789023927.047962:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789023927.047974:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226176:12345-0@lo:502: 00000100:00100000:0.0:1789023927.048136:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226176:12345-0@lo:502: Request processed in 164us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.048180:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789023927.048285:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226176:0@lo:502: 00000040:00080000:1.0:1789023927.048606:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789023927.048642:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789023927.048657:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789023927.048672:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789023927.048686:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789023927.048698:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789023927.048724:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226304:0@lo:502: 00000100:00100000:1.0:1789023927.048769:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.049630:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.049729:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226304 00000100:00100000:2.0:1789023927.049739:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226304 00000100:00100000:2.0:1789023927.049785:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789023927.049807:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226304:12345-0@lo:502: 00000100:00100000:2.0:1789023927.050237:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226304:12345-0@lo:502: Request processed in 442us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.050246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789023927.050431:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226304:0@lo:502: 00000040:00080000:1.0:1789023927.050525:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789023927.050540:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789023927.051754:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789023927.051768:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789023927.051778:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023927.051914:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789023927.051925:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789023927.051946:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90cc35450000) 00000020:00000080:2.0:1789023927.052041:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789023927.052050:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789023927.052618:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc3bd3a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789023927.052628:0:8447:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789023927.052638:0:8447:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa736ef4b98cb33d4 00010000:00010000:2.0:1789023927.060435:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789023927.061037:0:8447:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789023927.067137:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789023927.067723:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789023927.076029:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789023927.076658:0:8447:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789023927.094269:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789023927.097218:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789023927.097235:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023927.097243:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023927.097245:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789023927.097250:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023927.097255:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023927.097256:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789023927.097259:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789023927.097261:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789023927.097295:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023927.097298:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023927.097299:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789023927.097892:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789023927.098050:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789023927.098108:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789023927.098174:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.098190:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023927.098201:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc3bd3a000 from 1 10000000:01000000:2.0:1789023927.098205:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023927.098257:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.098269:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.098283:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.098311:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226432:0@lo:101: 00000100:00100000:2.0:1789023927.098985:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023927.099044:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07d010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.099085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226432 00000100:00100000:2.0:1789023927.099095:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226432 00000100:00100000:2.0:1789023927.099189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789023927.099200:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:8424:x1875927422226432:12345-0@lo:101: 00010000:00010000:2.0:1789023927.099215:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023927.099229:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb33db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.099259:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.099271:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.099281:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0c00, rc 0) 00000100:00100000:2.0:1789023927.099350:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226432:12345-0@lo:101: Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.099357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789023927.099621:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226432:0@lo:101: 00010000:00010000:3.0:1789023927.099640:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.099650:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023927.099804:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226560:0@lo:501: 00000100:00100000:3.0:1789023927.099841:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.099871:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.099962:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226560 00000100:00100000:2.0:1789023927.099967:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226560 00000100:00100000:2.0:1789023927.100001:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789023927.100009:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226560:12345-0@lo:501: 00000100:00100000:2.0:1789023927.100133:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226560:12345-0@lo:501: Request processed in 124us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.100140:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789023927.100256:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226560:0@lo:501: 00000100:00100000:0.0:1789023927.100287:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226688:0@lo:503: 00000100:00100000:0.0:1789023927.100349:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.100449:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19994480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.101019:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226688 00000100:00100000:2.0:1789023927.101033:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226688 00000100:00100000:2.0:1789023927.101070:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789023927.101077:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226688:12345-0@lo:503: 00000100:00100000:2.0:1789023927.101195:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226688:12345-0@lo:503: Request processed in 118us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.101202:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789023927.101305:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226688:0@lo:503: 00000040:00080000:0.0:1789023927.101589:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023927.101667:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226816:0@lo:502: 00000100:00100000:0.0:1789023927.101732:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.101748:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.101773:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226816 00000100:00100000:0.0:1789023927.101777:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226816 00000100:00100000:0.0:1789023927.101801:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789023927.101807:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226816:12345-0@lo:502: 00000100:00100000:0.0:1789023927.101890:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226816:12345-0@lo:502: Request processed in 82us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.101897:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789023927.101928:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226816:0@lo:502: 00000040:00080000:0.0:1789023927.102176:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789023927.102202:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789023927.102219:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226944:0@lo:502: 00000100:00100000:0.0:1789023927.102249:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.102258:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.102275:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422226944 00000100:00100000:0.0:1789023927.102279:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422226944 00000100:00100000:0.0:1789023927.102294:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789023927.102299:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226944:12345-0@lo:502: 00000100:00100000:0.0:1789023927.102363:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422226944:12345-0@lo:502: Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.102370:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789023927.102411:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422226944:0@lo:502: 00000040:00080000:0.0:1789023927.102450:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789023927.102458:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789023927.103461:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023927.103481:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023927.103484:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789023927.103491:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc3bd3a000 00000020:00000080:3.0:1789023927.103494:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789023927.103507:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023927.103509:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023927.103518:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789023927.103521:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789023927.103823:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789023927.103855:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023927.103880:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.103905:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023927.103958:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789023927.103961:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cc3bd3a000 10000000:01000000:0.0:1789023927.103964:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cc3bd3a000 10000000:01000000:0.0:1789023927.103968:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023927.103974:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc3bd3a000 from 1 10000000:01000000:0.0:1789023927.103977:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023927.104011:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.104019:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.104029:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023927.104051:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227072:0@lo:101: 00000100:00100000:0.0:1789023927.104101:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.104142:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023927.104306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227072 00000100:00100000:3.0:1789023927.104314:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227072 00000100:00100000:3.0:1789023927.104361:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789023927.104370:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8424:x1875927422227072:12345-0@lo:101: 00010000:00010000:3.0:1789023927.104382:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023927.104396:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb33e9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.104421:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.104434:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.104445:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4400, rc 0) 00000100:00100000:3.0:1789023927.104509:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227072:12345-0@lo:101: Request processed in 138us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023927.104516:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789023927.104597:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227072:0@lo:101: 00010000:00010000:0.0:1789023927.104612:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.104622:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023927.104743:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227200:0@lo:501: 00000100:00100000:0.0:1789023927.104778:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.104807:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023927.104859:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227200 00000100:00100000:2.0:1789023927.104864:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227200 00000100:00100000:2.0:1789023927.104899:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789023927.104907:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227200:12345-0@lo:501: 00000100:00100000:2.0:1789023927.105005:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227200:12345-0@lo:501: Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.105012:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789023927.105079:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227200:0@lo:501: 00000100:00100000:0.0:1789023927.105108:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227328:0@lo:503: 00000100:00100000:0.0:1789023927.105174:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.105194:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.105208:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227328 00000100:00100000:0.0:1789023927.105212:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227328 00000100:00100000:0.0:1789023927.105230:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789023927.105235:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227328:12345-0@lo:503: 00000100:00100000:0.0:1789023927.105307:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227328:12345-0@lo:503: Request processed in 71us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.105314:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789023927.105365:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227328:0@lo:503: 00000040:00080000:0.0:1789023927.105611:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023927.105679:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227456:0@lo:502: 00000100:00100000:0.0:1789023927.105721:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.105748:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428480 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.105765:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227456 00000100:00100000:0.0:1789023927.105769:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227456 00000100:00100000:0.0:1789023927.105795:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789023927.105802:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227456:12345-0@lo:502: 00000100:00100000:0.0:1789023927.105883:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227456:12345-0@lo:502: Request processed in 81us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.105897:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789023927.105933:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227456:0@lo:502: 00000040:00080000:0.0:1789023927.106134:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789023927.106184:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789023927.106200:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789023927.106215:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789023927.106228:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789023927.106241:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789023927.106252:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789023927.106262:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789023927.106273:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789023927.106284:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789023927.106295:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789023927.106305:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789023927.106315:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789023927.106326:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789023927.106336:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789023927.106346:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789023927.106356:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789023927.106367:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789023927.106377:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789023927.106388:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789023927.106398:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789023927.106408:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789023927.106418:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789023927.106428:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789023927.106440:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789023927.106480:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789023927.106494:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789023927.106507:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789023927.106520:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789023927.106540:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789023927.106551:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789023927.106565:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789023927.106577:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789023927.106594:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789023927.106607:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789023927.106621:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789023927.106632:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1789023927.106652:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227584:0@lo:502: 00000100:00100000:0.0:1789023927.106694:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.106729:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.106748:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227584 00000100:00100000:0.0:1789023927.106752:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227584 00000100:00100000:0.0:1789023927.106775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789023927.106782:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227584:12345-0@lo:502: 00000100:00100000:0.0:1789023927.106851:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422227584:12345-0@lo:502: Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.106858:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789023927.106890:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422227584:0@lo:502: 00000040:00080000:0.0:1789023927.106920:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789023927.106927:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789023927.108817:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789023927.108854:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90cb020a99c0) 00000020:00000080:3.0:1789023927.108884:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789023927.108987:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc3bd3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789023927.108992:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc3bd3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789023927.108995:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc3bd3a000 3 00010000:00080000:3.0:1789023927.109026:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3543f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.118@tcp at head 00010000:00010000:3.0:1789023927.110737:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789023927.110930:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789023927.110973:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789023927.110995:0:8452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa736ef4b98cb33fe 00000100:00080000:3.0:1789023927.111005:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023927.111016:0:8452:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90cc3543f800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789023927.111056:0:8452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc199bd180 x1875927422227712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023927.111071:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789023927.111186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422227840:0@lo:400: 00000100:00100000:3.0:1789023927.111244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.111277:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023927.111281:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422228224:0@lo:400: 00000100:00100000:3.0:1789023927.111302:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.111322:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422227968:0@lo:400: 00000100:00100000:3.0:1789023927.111339:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.111354:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023927.111358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422228096:0@lo:400: 00000100:00100000:3.0:1789023927.111373:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.111396:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228224 00000100:00100000:3.0:1789023927.111403:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228224 00000100:00100000:3.0:1789023927.111450:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227968 00000100:00100000:3.0:1789023927.111453:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227968 00000100:00100000:3.0:1789023927.111479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023927.111488:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422228224:12345-0@lo:400: 00000100:00100000:3.0:1789023927.111535:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422228224:12345-0@lo:400: Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023927.111542:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023927.111554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023927.111559:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422227968:12345-0@lo:400: 00000100:00100000:3.0:1789023927.111590:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422227968:12345-0@lo:400: Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023927.111596:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023927.111627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422227968:0@lo:400: 00000100:00100000:3.0:1789023927.111646:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422228224:0@lo:400: 00000100:00100000:2.0:1789023927.115732:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422227712:0@lo:38: 00000100:00100000:2.0:1789023927.115815:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023927.115895:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227840 00000100:00100000:2.0:1789023927.115904:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227840 00000100:00100000:2.0:1789023927.115951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228096 00000100:00100000:2.0:1789023927.115955:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228096 00000100:00100000:2.0:1789023927.115968:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422227712 00000100:00100000:2.0:1789023927.115971:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422227712 00000100:00100000:2.0:1789023927.115983:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789023927.115991:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422227840:12345-0@lo:400: 00000100:00100000:2.0:1789023927.116049:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422227840:12345-0@lo:400: Request processed in 58us (4805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.116057:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789023927.116075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789023927.116081:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422228096:12345-0@lo:400: 00000100:00100000:2.0:1789023927.116123:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422228096:12345-0@lo:400: Request processed in 42us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.116129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789023927.116141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023927.116169:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422227712:12345-0@lo:38: 00010000:00080000:2.0:1789023927.116193:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1789023927.116229:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa736ef4b98cb3405 00000004:00100000:2.0:1789023927.116243:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789023927.116278:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cb01a1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023927.116314:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875927422227712:12345-0@lo:38: Request processed in 168us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.116320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789023927.116367:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc199bd180 x1875927422227712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023927.116377:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023927.116386:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789023927.116393:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789023927.116398:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789023927.116401:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789023927.116408:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422227712:0@lo:38: 00010000:00010000:3.0:1789023927.120344:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1789023927.120415:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc199bf480 x1875927422228096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023927.120437:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422228096:0@lo:400: 00010000:00080000:3.0:1789023927.120498:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc199bed80 x1875927422227840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023927.120507:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422227840:0@lo:400: 00000020:01000004:3.0:1789023927.120620:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789023927.120636:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90cb020acd40) 00000020:00000080:3.0:1789023927.120658:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1789023927.120766:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc3bd3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789023927.120770:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc3bd3a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789023927.120773:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc3bd3a000 3 00010000:00080000:3.0:1789023927.120872:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb021fc000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.118@tcp at head 00010000:00010000:3.0:1789023927.129921:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1789023927.131313:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789023927.131367:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789023927.131381:0:8452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa736ef4b98cb3413 00000100:00080000:3.0:1789023927.131394:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023927.131408:0:8452:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90cb021fc000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789023927.133402:0:8452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc199bed80 x1875927422228352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023927.133441:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789023927.133680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422228352:0@lo:38: 00000100:00100000:1.0:1789023927.133764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023927.134582:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228352 00000100:00100000:3.0:1789023927.134593:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228352 00000100:00100000:3.0:1789023927.134645:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023927.134654:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422228352:12345-0@lo:38: 00010000:00080000:3.0:1789023927.134687:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1789023927.134738:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa736ef4b98cb341a 00000004:00100000:3.0:1789023927.134753:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789023927.134787:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cb021fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023927.134872:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875927422228352:12345-0@lo:38: Request processed in 218us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023927.134879:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789023927.134979:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bed80 x1875927422228352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023927.134992:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789023927.135000:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789023927.135008:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789023927.135013:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789023927.135016:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb021fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789023927.135022:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422228352:0@lo:38: 00000040:00080000:3.0:1789023927.135342:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1789023927.135554:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789023927.135602:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023927.135626:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023927.135639:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789023927.135694:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789023927.135696:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789023927.135697:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023927.135698:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023927.135705:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023927.135706:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023927.135709:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023927.135710:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023927.135711:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023927.135713:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023927.135714:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789023927.135718:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789023927.135721:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789023927.135722:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789023927.135723:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023927.135723:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023927.135724:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023927.135725:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023927.135726:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023927.135727:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023927.135728:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023927.135728:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023927.135729:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789023927.135752:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789023927.135769:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422228480:0@lo:253: 00000100:00100000:1.0:1789023927.135821:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023927.135861:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023927.135951:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228480 00000100:00100000:3.0:1789023927.135957:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228480 00000100:00100000:3.0:1789023927.136001:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789023927.136009:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422228480:12345-0@lo:253: 20000000:01000000:3.0:1789023927.136035:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789023927.136049:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789023927.153110:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789023927.153231:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789023927.153697:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:8424:x1875927422228480:12345-0@lo:253: Request processed in 17683us (17869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023927.153711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789023927.153958:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:8424:1875927422228480:0@lo:253: 10000000:01000000:1.0:1789023927.153977:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789023927.153980:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789023927.153982:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789023927.153983:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023927.153985:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023927.153986:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023927.153987:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023927.153989:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023927.153991:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023927.153992:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023927.153994:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023927.153995:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789023927.154010:0:8424:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789023927.156001:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789023927.156011:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789023927.156195:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156218:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156239:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156246:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156292:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156319:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 15 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023927.156335:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422228608:0@lo:104: 00000100:00100000:3.0:1789023927.156406:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023927.156462:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.156480:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 15 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023927.156489:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422228736:0@lo:104: 00000100:00100000:3.0:1789023927.156508:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023927.156584:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789023927.156604:0:6499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023927.156632:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228608 00000100:00100000:0.0:1789023927.156640:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228608 00000100:00100000:0.0:1789023927.156681:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228736 00000100:00100000:0.0:1789023927.156684:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228736 00000100:00100000:0.0:1789023927.156700:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023927.156708:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6531:x1875927422228608:12345-0@lo:104: 00010000:00010000:0.0:1789023927.156729:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.156784:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023927.156790:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:6531:x1875927422228608:12345-0@lo:104: Request processed in 83us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.156797:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023927.156846:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023927.156851:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422228736:12345-0@lo:104: 00010000:00010000:0.0:1789023927.156858:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.156888:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789023927.156892:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422228736:12345-0@lo:104: Request processed in 42us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023927.156898:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789023927.156914:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023927.156920:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.156927:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023927.156932:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.156941:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023927.156949:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023927.156961:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023927.156990:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.156996:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023927.157011:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157017:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb332c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3333 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157031:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023927.157034:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157038:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023927.157041:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157048:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023927.157053:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023927.157058:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023927.157069:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157074:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023927.157094:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157100:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb3310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3317 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023927.157114:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023927.157115:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023927.157117:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023927.157296:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023927.157319:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422228864:0@lo:103: 00000100:00100000:2.0:1789023927.157353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023927.157388:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023927.157403:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422228992:0@lo:103: 00000100:00100000:2.0:1789023927.157425:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023927.157454:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228864 00000100:00100000:2.0:1789023927.157458:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228864 00010000:00010000:2.0:1789023927.157488:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 16 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.157507:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422228992 00000100:00100000:2.0:1789023927.157510:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422228992 00010000:00010000:2.0:1789023927.157522:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.157538:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023927.157544:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422228864:12345-0@lo:103: 00010000:00010000:2.0:1789023927.157555:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023927.157560:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157569:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 17 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157584:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023927.157611:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422228864:12345-0@lo:103: Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.157617:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023927.157630:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023927.157637:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+16:3644:x1875927422228992:12345-0@lo:103: 00010000:00010000:2.0:1789023927.157645:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023927.157649:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 16 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157664:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 16 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157675:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157684:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023927.157699:0:7924:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013681449s 00010000:00010000:2.0:1789023927.157704:0:7924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157712:0:7924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157719:0:7924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157726:0:7924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157731:0:7924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789023927.157735:0:7924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157742:0:7924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157750:0:7924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157770:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023927.157799:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+16:3644:x1875927422228992:12345-0@lo:103: Request processed in 162us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023927.157805:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023927.157856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422228864:0@lo:103: 00000100:00100000:2.0:1789023927.157879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422228992:0@lo:103: 00010000:00010000:2.0:1789023927.157896:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb3333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb332c expref: 15 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.157905:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422228608:0@lo:104: 00010000:00010000:2.0:1789023927.157913:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5600/0xa736ef4b98cb3317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3310 expref: 14 pid: 6508 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023927.157919:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422228736:0@lo:104: 00010000:00010000:2.0:1789023927.157933:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157941:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157947:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023927.157953:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3421 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023927.158425:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789023927.163907:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789023927.164097:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789023927.164328:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789023927.164487:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789023927.164713:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789023927.164943:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789023927.166450:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789023927.188177:0:8424:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789023927.188189:0:8424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789023927.188223:0:8424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789023927.188268:0:8424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789023927.188292:0:8424:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789023927.188428:0:8424:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789023927.189107:0:8424:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023927.189667:0:8424:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:0.0:1789023928.004126:0:8508:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789023928.004761:0:8508:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789023928.142919:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023928.731985:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023928.732010:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422229120:0@lo:41: 00000100:00100000:3.0:1789023928.732072:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023928.732197:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229120 00000100:00100000:3.0:1789023928.732205:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229120 00000100:00100000:3.0:1789023928.732258:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023928.732267:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422229120:12345-0@lo:41: 00000004:00000024:3.0:1789023928.732301:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789023928.732345:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422229120:12345-0@lo:41: Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023928.732352:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023928.732396:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422229120:0@lo:41: 00010000:00010000:0.0:1789023929.165650:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023930.188751:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023931.212372:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023931.788329:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023931.788354:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422229248:0@lo:41: 00000100:00100000:1.0:1789023931.788516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023931.788593:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229248 00000100:00100000:1.0:1789023931.788602:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229248 00000100:00100000:1.0:1789023931.788646:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023931.788655:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422229248:12345-0@lo:41: 00000004:00000024:1.0:1789023931.788694:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789023931.788757:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422229248:12345-0@lo:41: Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023931.788765:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023931.788814:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422229248:0@lo:41: 00010000:00010000:3.0:1789023932.237799:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023932.306627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422229760:0@lo:400: 00000100:00100000:2.0:1789023932.306696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.306880:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789023932.306889:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422229376:0@lo:400: 00000100:00100000:2.0:1789023932.306920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.306944:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422229888:0@lo:400: 00000100:00100000:2.0:1789023932.306968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.306993:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422229504:0@lo:400: 00000100:00100000:2.0:1789023932.307035:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.307052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422230016:0@lo:400: 00000100:00100000:2.0:1789023932.307080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.307097:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789023932.307103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422229632:0@lo:400: 00000100:00100000:2.0:1789023932.307120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023932.307133:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422230144:0@lo:400: 00000100:00100000:2.0:1789023932.307169:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023932.309946:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229760 00000100:00100000:0.0:1789023932.309963:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229760 00000100:00100000:0.0:1789023932.310001:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229504 00000100:00100000:0.0:1789023932.310004:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229504 00000100:00100000:0.0:1789023932.310014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230016 00000100:00100000:0.0:1789023932.310017:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230016 00000100:00100000:0.0:1789023932.310053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230144 00000100:00100000:0.0:1789023932.310057:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230144 00000100:00100000:0.0:1789023932.310074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023932.310083:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422229760:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310195:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422229760:12345-0@lo:400: Request processed in 112us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023932.310219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023932.310225:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422229504:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310258:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422229504:12345-0@lo:400: Request processed in 34us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023932.310285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023932.310291:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422230016:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310318:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422230016:12345-0@lo:400: Request processed in 29us (3238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310324:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023932.310335:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023932.310341:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422230144:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310366:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422230144:12345-0@lo:400: Request processed in 26us (3197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023932.310391:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229888 00000100:00100000:0.0:1789023932.310395:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229888 00000100:00100000:0.0:1789023932.310415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229632 00000100:00100000:0.0:1789023932.310427:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229632 00000100:00100000:0.0:1789023932.310443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023932.310449:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422229888:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310481:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422229888:12345-0@lo:400: Request processed in 32us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023932.310498:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023932.310503:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422229632:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310526:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422229632:12345-0@lo:400: Request processed in 24us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310532:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023932.310558:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422229376 00000100:00100000:0.0:1789023932.310562:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422229376 00000100:00100000:0.0:1789023932.310586:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789023932.310597:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:3641:x1875927422229376:12345-0@lo:400: 00000100:00100000:0.0:1789023932.310626:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:3641:x1875927422229376:12345-0@lo:400: Request processed in 30us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023932.310632:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1789023932.310741:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023932.310751:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023932.311236:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422229632:0@lo:400: 00010000:00080000:1.0:1789023932.311253:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9d180 x1875927422230144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023932.311266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422230144:0@lo:400: 00010000:00080000:1.0:1789023932.311277:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9e680 x1875927422229504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023932.311286:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422229504:0@lo:400: 00010000:00080000:1.0:1789023932.311301:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9ed80 x1875927422230016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023932.311309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422230016:0@lo:400: 00000100:00100000:1.0:1789023932.311345:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422229376:0@lo:400: 00000100:00100000:1.0:1789023932.311356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422229888:0@lo:400: 00010000:00080000:1.0:1789023932.311367:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9e300 x1875927422229760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023932.311376:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422229760:0@lo:400: 00000001:02000400:0.0:1789023932.540070:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789023933.260368:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789023933.389704:0:8850:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789023933.389928:0:8850:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789023933.838439:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422230272:0@lo:41: 00000100:00100000:1.0:1789023933.838549:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023933.838618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230272 00000100:00100000:0.0:1789023933.838631:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230272 00000100:00100000:0.0:1789023933.838702:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023933.838714:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422230272:12345-0@lo:41: 00000004:00000024:0.0:1789023933.838765:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789023933.838829:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422230272:12345-0@lo:41: Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023933.838836:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023933.838895:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422230272:0@lo:41: 00010000:00010000:3.0:1789023934.284378:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789023934.349818:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789023934.349833:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc414b7800 from 30 10000000:01000000:0.0:1789023934.349841:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023934.349909:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.349926:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.349942:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.349975:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230400:0@lo:101: 00000100:00100000:0.0:1789023934.350081:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.350164:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.353013:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230400 00000100:00100000:3.0:1789023934.353036:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230400 00000100:00100000:3.0:1789023934.353186:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789023934.353200:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+14:6512:x1875927422230400:12345-0@lo:101: 00010000:00010000:3.0:1789023934.353224:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023934.353249:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3428 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.353286:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.353300:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.353311:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:3.0:1789023934.353431:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422230400:12345-0@lo:101: Request processed in 235us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.353439:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789023934.354747:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230400:0@lo:101: 00010000:00010000:3.0:1789023934.354864:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.354877:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023934.354997:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230528:0@lo:501: 00000100:00100000:3.0:1789023934.355069:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.355122:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.355638:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230528 00000100:00100000:0.0:1789023934.355649:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230528 00000100:00100000:0.0:1789023934.355708:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789023934.355719:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422230528:12345-0@lo:501: 00000100:00100000:0.0:1789023934.355979:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422230528:12345-0@lo:501: Request processed in 261us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.355987:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789023934.356045:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230528:0@lo:501: 00000100:00100000:0.0:1789023934.356084:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230656:0@lo:503: 00000100:00100000:0.0:1789023934.356133:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.356182:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.356195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230656 00000100:00100000:0.0:1789023934.356199:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230656 00000100:00100000:0.0:1789023934.356222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789023934.356228:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422230656:12345-0@lo:503: 00000100:00100000:0.0:1789023934.356315:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422230656:12345-0@lo:503: Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.356322:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789023934.356360:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422230656:0@lo:503: 00000100:00100000:0.0:1789023934.358885:0:8885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8885:1875927422230784:0@lo:502: 00000100:00100000:0.0:1789023934.358991:0:8885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.359051:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230784 00000100:00100000:0.0:1789023934.359059:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230784 00000100:00100000:0.0:1789023934.359113:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789023934.359130:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:8885:x1875927422230784:12345-0@lo:502: 00000100:00100000:0.0:1789023934.361724:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:8885:x1875927422230784:12345-0@lo:502: Request processed in 2579us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.361742:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789023934.361917:0:8885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.361952:0:8885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8885:1875927422230784:0@lo:502: 00000100:00100000:0.0:1789023934.362043:0:8885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8885:1875927422230912:0@lo:502: 00000100:00100000:0.0:1789023934.362094:0:8885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.362125:0:8885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.362271:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422230912 00000100:00100000:3.0:1789023934.362279:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422230912 00000100:00100000:3.0:1789023934.362326:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789023934.362336:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8885:x1875927422230912:12345-0@lo:502: 00000100:00100000:3.0:1789023934.362469:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:8885:x1875927422230912:12345-0@lo:502: Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.362476:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789023934.362861:0:8885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8885:1875927422230912:0@lo:502: 00000040:00080000:0.0:1789023934.362887:0:8885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789023934.362970:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789023934.362996:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023934.363007:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.363021:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023934.363033:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789023934.363036:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc414b7800 from 5 10000000:01000000:0.0:1789023934.363040:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789023934.363077:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.363086:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.363109:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.363124:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231040:0@lo:101: 00000100:00100000:0.0:1789023934.365495:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.366728:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.367239:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231040 00000100:00100000:0.0:1789023934.367252:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231040 00000100:00100000:0.0:1789023934.370211:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023934.370241:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422231040:12345-0@lo:101: 00010000:00010000:0.0:1789023934.370268:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023934.370298:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3436 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.370351:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.370364:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.370374:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489200, rc 0) 00000100:00100000:0.0:1789023934.370485:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422231040:12345-0@lo:101: Request processed in 257us (5001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.370494:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023934.376456:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231040:0@lo:101: 00010000:00010000:0.0:1789023934.376502:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.376603:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.376702:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231168:0@lo:256: 00000100:00100000:0.0:1789023934.376868:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.376921:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.377271:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231168 00000100:00100000:3.0:1789023934.377283:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231168 00000100:00100000:3.0:1789023934.377391:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789023934.377413:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422231168:12345-0@lo:256: 20000000:01000000:3.0:1789023934.377442:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023934.377464:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023934.377467:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789023934.377655:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422231168:12345-0@lo:256: Request processed in 253us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.377663:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789023934.377715:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231168:0@lo:256: 10000000:01000000:3.0:1789023934.378852:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789023934.378870:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.378885:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023934.378896:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789023934.378899:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789023934.378903:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789023934.378949:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.378958:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.378969:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023934.378994:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231296:0@lo:101: 00000100:00100000:3.0:1789023934.379053:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.379106:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.379694:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231296 00000100:00100000:1.0:1789023934.379704:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231296 00000100:00100000:3.0:1789023934.380466:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789023934.380483:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422231296:12345-0@lo:101: 00010000:00010000:3.0:1789023934.380504:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023934.380524:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3444 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.380933:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.380956:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.380966:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4e00, rc 0) 00000100:00100000:3.0:1789023934.381056:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422231296:12345-0@lo:101: Request processed in 578us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.381063:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789023934.381308:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231296:0@lo:101: 00010000:00010000:1.0:1789023934.381329:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023934.381453:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023934.381621:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231424:0@lo:501: 00000100:00100000:1.0:1789023934.381663:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.381706:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.382642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231424 00000100:00100000:3.0:1789023934.382654:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231424 00000100:00100000:3.0:1789023934.382710:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789023934.382720:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422231424:12345-0@lo:501: 00000100:00100000:3.0:1789023934.383139:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422231424:12345-0@lo:501: Request processed in 419us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.383179:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023934.386839:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231424:0@lo:501: 00000100:00100000:0.0:1789023934.391341:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231552:0@lo:503: 00000100:00100000:0.0:1789023934.391471:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.391540:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be780 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.391612:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231552 00000100:00100000:2.0:1789023934.391624:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231552 00000100:00100000:2.0:1789023934.391688:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789023934.391698:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422231552:12345-0@lo:503: 00000100:00100000:2.0:1789023934.391845:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422231552:12345-0@lo:503: Request processed in 148us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.391854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789023934.392428:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422231552:0@lo:503: 00000100:00100000:0.0:1789023934.393132:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8888:1875927422231680:0@lo:502: 00000100:00100000:0.0:1789023934.393232:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.393271:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.393334:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231680 00000100:00100000:2.0:1789023934.393340:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231680 00000100:00100000:2.0:1789023934.393386:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789023934.393415:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:8888:x1875927422231680:12345-0@lo:502: 00000100:00100000:2.0:1789023934.393553:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:8888:x1875927422231680:12345-0@lo:502: Request processed in 151us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.393561:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789023934.393803:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8888:1875927422231680:0@lo:502: 00000020:01000000:0.0:1789023934.393846:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023934.393855:0:8888:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789023934.393863:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023934.393866:0:8888:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789023934.393878:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789023934.393882:0:8888:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789023934.393909:0:8888:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789023934.393912:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023934.393930:0:8888:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90cc415a3380) 00000020:00000080:0.0:1789023934.393960:0:8888:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789023934.393975:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789023934.394073:0:8888:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789023934.394081:0:8888:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789023934.394089:0:8888:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb3459 00010000:00080000:0.0:1789023934.394124:0:8888:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc34513000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789023934.397748:0:8888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789023934.420191:0:8888:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789023934.420225:0:8888:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789023934.420514:0:8888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023934.421093:0:8888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023934.421271:0:8888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789023934.422120:0:8888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789023934.423002:0:8890:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789023934.423011:0:8890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789023934.426541:0:8888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789023934.426557:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789023934.426604:0:8888:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789023934.426627:0:8888:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb3460 00000100:00080000:2.0:1789023934.426637:0:8888:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789023934.427563:0:8888:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90cc34513000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789023934.427604:0:8888:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb021d1500 x1875927422231808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789023934.427631:0:8888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789023934.427714:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023934.427719:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023934.427721:0:8888:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789023934.427724:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023934.427728:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023934.427729:0:8888:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789023934.427732:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789023934.427734:0:8888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789023934.427763:0:8888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8888:1875927422231936:0@lo:502: 00000100:00100000:2.0:1789023934.427849:0:8888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.427904:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231936 00000100:00100000:2.0:1789023934.427912:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231936 00000100:00100000:2.0:1789023934.427953:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789023934.427962:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:8888:x1875927422231936:12345-0@lo:502: 00000100:00100000:2.0:1789023934.428070:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:8888:x1875927422231936:12345-0@lo:502: Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.428077:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789023934.428127:0:8888:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.428164:0:8888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8888:1875927422231936:0@lo:502: 00000020:01000000:2.0:1789023934.428186:0:8888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023934.428190:0:8888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023934.428192:0:8888:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789023934.428196:0:8888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1789023934.428245:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1789023934.428265:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789023934.428275:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023934.428287:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023934.428296:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023934.428299:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc199e6000 from 30 10000000:01000000:2.0:1789023934.428302:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:1.0:1789023934.428469:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422231808:0@lo:8: 00000100:00100000:1.0:1789023934.428563:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.429737:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422231808 00000100:00100000:0.0:1789023934.429748:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422231808 00000100:00100000:0.0:1789023934.429776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023934.429787:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422231808:12345-0@lo:8: 00010000:00080000:0.0:1789023934.429813:0:8431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1789023934.429839:0:8431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb3467 00002000:00100000:0.0:1789023934.429877:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90cc34516000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789023934.429881:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789023934.429884:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789023934.429943:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789023934.430074:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422232576:0@lo:400: 00000100:00100000:1.0:1789023934.430174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.430227:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789023934.430237:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422232192:0@lo:400: 00000100:00100000:1.0:1789023934.430276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789023934.430279:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1789023934.430313:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422232704:0@lo:400: 00000100:00080000:0.0:1789023934.430321:0:8431:0:(import.c:65:import_set_state_nolock()) ffff90cc35389000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023934.430345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.430410:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232576 00000100:00100000:1.0:1789023934.430418:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232576 00000100:00100000:0.0:1789023934.430429:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422231808:12345-0@lo:8: Request processed in 642us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.430470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023934.430479:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422232576:12345-0@lo:400: 00000100:00100000:0.0:1789023934.430517:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023934.430553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422232320:0@lo:400: 00000100:00100000:0.0:1789023934.430594:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.430633:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422232576:12345-0@lo:400: Request processed in 152us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.430639:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422232832:0@lo:400: 00000100:00100000:1.0:1789023934.430654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023934.430678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232320 00000100:00100000:0.0:1789023934.430687:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.430697:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232320 00000100:00100000:0.0:1789023934.430726:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023934.430733:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789023934.430741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422232448:0@lo:400: 00000100:00100000:1.0:1789023934.430746:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422232320:12345-0@lo:400: 00000100:00100000:1.0:1789023934.430811:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422232320:12345-0@lo:400: Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.430819:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789023934.430861:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422232576:0@lo:400: 00010000:00010000:2.0:1789023934.431601:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023934.431614:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023934.431639:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023934.431660:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422232064:0@lo:101: 00000100:00100000:2.0:1789023934.431706:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.431738:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.431896:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.431897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232064 00000100:00100000:1.0:1789023934.431907:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232064 00000100:00100000:0.0:1789023934.431948:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422232320:0@lo:400: 00000100:00100000:1.0:1789023934.431965:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789023934.431978:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422232064:12345-0@lo:101: 00010000:00010000:1.0:1789023934.431992:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023934.432014:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb346e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023934.432043:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023934.432056:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023934.432067:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160800, rc 0) 00000100:00100000:1.0:1789023934.432115:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422232064:12345-0@lo:101: Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.432123:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789023934.432188:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422232064:0@lo:101: 00010000:00010000:2.0:1789023934.432236:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023934.432248:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023934.432334:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422232960:0@lo:501: 00000100:00100000:2.0:1789023934.432376:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.432418:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.432447:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232960 00000100:00100000:0.0:1789023934.432791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232192 00000100:00100000:0.0:1789023934.432801:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232192 00000100:00100000:0.0:1789023934.432841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232704 00000100:00100000:0.0:1789023934.432844:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232704 00000100:00100000:0.0:1789023934.432871:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232832 00000100:00100000:0.0:1789023934.432874:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232832 00000100:00100000:0.0:1789023934.432891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422232448 00000100:00100000:0.0:1789023934.432894:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232448 00000100:00080000:1.0:1789023934.432907:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023934.432915:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023934.432917:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023934.432929:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422232192:12345-0@lo:400: 00000100:00100000:0.0:1789023934.433004:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422232192:12345-0@lo:400: Request processed in 76us (2728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.433011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789023934.433677:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0ffb80 x1875927422232192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.433710:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422232192:0@lo:400: 00000100:00100000:2.0:1789023934.434095:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422232960 00010000:00080000:1.0:1789023934.434191:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d1500 x1875927422231808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023934.434199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789023934.434221:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789023934.434224:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422232960:12345-0@lo:501: 00000100:00080000:1.0:1789023934.434234:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789023934.434246:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789023934.434255:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789023934.434260:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc34513000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789023934.434279:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789023934.434290:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422231808:0@lo:8: 00000100:00100000:2.0:1789023934.434492:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422232960:12345-0@lo:501: Request processed in 272us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.434501:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789023934.434559:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422232960:0@lo:501: 00000100:00100000:2.0:1789023934.434617:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233088:0@lo:503: 00000100:00100000:2.0:1789023934.434690:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.434723:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.434740:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233088 00000100:00100000:2.0:1789023934.434744:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233088 00000100:00100000:2.0:1789023934.434770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789023934.434777:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422233088:12345-0@lo:503: 00000100:00100000:2.0:1789023934.434859:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422233088:12345-0@lo:503: Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.434868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789023934.434911:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233088:0@lo:503: 00000100:00100000:1.0:1789023934.437643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023934.437672:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422232704:12345-0@lo:400: 00000100:00100000:1.0:1789023934.438044:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422232704:12345-0@lo:400: Request processed in 382us (7695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.438056:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023934.438109:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023934.438120:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422232832:12345-0@lo:400: 00010000:00080000:2.0:1789023934.438172:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fc000 x1875927422232704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023934.438195:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422232704:0@lo:400: 00000100:00100000:1.0:1789023934.438206:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422232832:12345-0@lo:400: Request processed in 87us (7519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.438215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023934.438237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789023934.438245:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422232448:12345-0@lo:400: 00000100:00100000:1.0:1789023934.438276:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422232448:12345-0@lo:400: Request processed in 32us (6382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.438296:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789023934.438375:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422233216:0@lo:700: 00000100:00100000:1.0:1789023934.440029:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.440092:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.440120:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233216 00000004:00080000:1.0:1789023934.440123:0:8890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789023934.440136:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233216 00000004:00080000:1.0:1789023934.440234:0:8890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 252476086072ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789023934.440255:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023934.440270:0:8440:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:3.0:1789023934.440271:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8891:x1875927422233216:12345-0@lo:700: 00000100:00100000:1.0:1789023934.440288:0:8440:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00080000:00080000:1.0:1789023934.440302:0:8890:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789023934.440347:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875927422233344:0@lo:700: 00000100:00100000:3.0:1789023934.440516:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.440626:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789023934.440651:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023934.441096:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233344 00000100:00100000:0.0:1789023934.441111:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233344 00000100:00100000:0.0:1789023934.441197:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023934.441209:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875927422233344:12345-0@lo:700: 00010000:00080000:0.0:1789023934.441619:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fc380 x1875927422232448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023934.441634:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422232448:0@lo:400: 00010000:00080000:0.0:1789023934.441654:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bc83480 x1875927422232832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023934.441667:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422232832:0@lo:400: 00000100:00100000:0.0:1789023934.442546:0:8893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8893:1875927422233472:0@lo:502: 00000100:00100000:0.0:1789023934.442630:0:8893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.442681:0:8893:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.442787:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233472 00000100:00100000:3.0:1789023934.442794:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233472 00000100:00100000:3.0:1789023934.442831:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789023934.442840:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:8893:x1875927422233472:12345-0@lo:502: 00000100:00100000:3.0:1789023934.442969:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:8893:x1875927422233472:12345-0@lo:502: Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.442978:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789023934.443136:0:8893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8893:1875927422233472:0@lo:502: 00000100:00100000:0.0:1789023934.443226:0:8893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8893:1875927422233600:0@lo:502: 00000100:00100000:0.0:1789023934.443264:0:8893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.443288:0:8893:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.443442:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233600 00000100:00100000:1.0:1789023934.443447:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233600 00000100:00100000:1.0:1789023934.443473:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789023934.443480:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:8893:x1875927422233600:12345-0@lo:502: 00000100:00100000:1.0:1789023934.443562:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:8893:x1875927422233600:12345-0@lo:502: Request processed in 82us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.443573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789023934.444246:0:8893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8893:1875927422233600:0@lo:502: 00000040:00080000:0.0:1789023934.444277:0:8893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789023934.444737:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789023934.444780:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789023934.444790:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.444803:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023934.444812:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789023934.444815:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc199e6000 from 5 10000000:01000000:3.0:1789023934.444818:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789023934.444848:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.444857:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.444872:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023934.444890:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233728:0@lo:101: 00000100:00100000:3.0:1789023934.444939:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789023934.445319:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789023934.445427:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.448002:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233728 00000100:00100000:1.0:1789023934.448016:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233728 00000100:00100000:0.0:1789023934.451879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789023934.451897:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422233728:12345-0@lo:101: 00010000:00010000:0.0:1789023934.451921:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023934.451948:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb347c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.451988:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.452000:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.452010:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488c00, rc 0) 00000100:00100000:0.0:1789023934.452110:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422233728:12345-0@lo:101: Request processed in 217us (7169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.452117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789023934.452215:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233728:0@lo:101: 00010000:00010000:0.0:1789023934.452257:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.452267:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.452337:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233856:0@lo:256: 00000100:00100000:0.0:1789023934.452380:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.452428:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.453523:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233856 00000100:00100000:0.0:1789023934.453537:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233856 00000100:00100000:0.0:1789023934.453588:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789023934.453597:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422233856:12345-0@lo:256: 20000000:01000000:0.0:1789023934.453628:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789023934.453652:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789023934.453655:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789023934.453770:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422233856:12345-0@lo:256: Request processed in 173us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.453778:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789023934.453959:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233856:0@lo:256: 10000000:01000000:0.0:1789023934.454015:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023934.454026:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454039:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023934.454050:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789023934.454059:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789023934.454063:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023934.454096:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454105:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454115:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.454133:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233984:0@lo:101: 00000100:00100000:0.0:1789023934.454186:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.454214:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.454228:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422233984 00000100:00100000:0.0:1789023934.454233:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422233984 00000100:00100000:0.0:1789023934.454261:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789023934.454268:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422233984:12345-0@lo:101: 00010000:00010000:0.0:1789023934.454278:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023934.454291:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb348a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454315:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454326:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023934.454346:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489e00, rc 0) 00000100:00100000:0.0:1789023934.454395:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422233984:12345-0@lo:101: Request processed in 127us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.454417:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789023934.456191:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422233984:0@lo:101: 00010000:00010000:2.0:1789023934.456231:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023934.456246:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023934.456330:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234112:0@lo:501: 00000100:00100000:2.0:1789023934.456389:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.456449:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.456457:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234112 00000100:00100000:3.0:1789023934.456465:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234112 00000100:00100000:3.0:1789023934.456506:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789023934.456515:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422234112:12345-0@lo:501: 00000100:00100000:3.0:1789023934.456659:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422234112:12345-0@lo:501: Request processed in 144us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.456668:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 40000000:02000000:3.0:1789023934.457279:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1789023934.458319:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234112:0@lo:501: 00000100:00100000:2.0:1789023934.458393:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234240:0@lo:503: 00000100:00100000:2.0:1789023934.458480:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.458510:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.458914:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234240 00000100:00100000:1.0:1789023934.458924:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234240 00000100:00100000:1.0:1789023934.458976:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789023934.458987:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422234240:12345-0@lo:503: 00000100:00100000:1.0:1789023934.459109:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422234240:12345-0@lo:503: Request processed in 123us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.459116:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789023934.459294:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234240:0@lo:503: 00000100:00100000:0.0:1789023934.460368:0:8897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8897:1875927422234368:0@lo:502: 00000100:00100000:0.0:1789023934.460439:0:8897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.460507:0:8897:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.460539:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234368 00000100:00100000:1.0:1789023934.460547:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234368 00000100:00100000:1.0:1789023934.460610:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789023934.460626:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:8897:x1875927422234368:12345-0@lo:502: 00000100:00100000:1.0:1789023934.460727:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:8897:x1875927422234368:12345-0@lo:502: Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.460734:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789023934.460808:0:8897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8897:1875927422234368:0@lo:502: 00000020:01000000:0.0:1789023934.460835:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023934.460842:0:8897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789023934.460848:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023934.460851:0:8897:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789023934.460856:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789023934.460859:0:8897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789023934.460880:0:8897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789023934.460882:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023934.460907:0:8897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90cc415a0000) 00000020:00000080:0.0:1789023934.460929:0:8897:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789023934.460936:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789023934.461033:0:8897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789023934.461038:0:8897:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789023934.461046:0:8897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb349f 00010000:00080000:0.0:1789023934.461073:0:8897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3d4b0000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789023934.461381:0:8897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1789023934.464259:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875927422233344:12345-0@lo:700: Request processed in 23041us (23731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.464285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789023934.464359:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bc380 x1875927422233344/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023934.464379:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875927422233344:0@lo:700: 40000000:02000000:3.0:1789023934.464407:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789023934.485212:0:8897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789023934.485237:0:8897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789023934.485776:0:8897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023934.486098:0:8897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023934.486237:0:8897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789023934.486350:0:8897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789023934.487853:0:8901:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023934.487859:0:8901:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789023934.489356:0:8897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023934.489369:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789023934.489420:0:8897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789023934.489444:0:8897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb34a6 00000100:00080000:0.0:1789023934.489453:0:8897:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023934.489464:0:8897:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90cc3d4b0000 using connection 192.168.202.118@tcp/0@lo 00000001:00100000:3.0:1789023934.490262:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1789023934.490458:0:8891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc34602a00 x1875927422233216/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.490475:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422233216:0@lo:700: 00000100:00100000:3.0:1789023934.490706:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422233216:12345-0@lo:700: Request processed in 50165us (50406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.490723:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023934.491095:0:8897:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bc83800 x1875927422234496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023934.491120:0:8897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789023934.491354:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023934.491362:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023934.491364:0:8897:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789023934.491369:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023934.491373:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023934.491374:0:8897:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789023934.491377:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789023934.491379:0:8897:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789023934.491424:0:8897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8897:1875927422234624:0@lo:502: 00000100:00100000:0.0:1789023934.491746:0:8897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.491792:0:8897:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3c029d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.491918:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234624 00000100:00100000:3.0:1789023934.491932:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234624 00000100:00100000:3.0:1789023934.492009:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789023934.492023:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:8897:x1875927422234624:12345-0@lo:502: 00000100:00100000:1.0:1789023934.492041:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422234496:0@lo:8: 00000100:00100000:1.0:1789023934.492089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.492228:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:8897:x1875927422234624:12345-0@lo:502: Request processed in 207us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.492237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789023934.492304:0:8897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:8897:1875927422234624:0@lo:502: 00000020:01000000:3.0:1789023934.492342:0:8897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023934.492349:0:8897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023934.492356:0:8897:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023934.492363:0:8897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789023934.492551:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789023934.492597:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789023934.492611:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492625:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023934.492637:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789023934.492641:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cc339999c0 from 1 10000000:01000000:3.0:1789023934.492645:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789023934.492679:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492689:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492699:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023934.492715:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234752:0@lo:101: 00000100:00100000:3.0:1789023934.492750:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.492780:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.492795:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234752 00000100:00100000:3.0:1789023934.492800:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234752 00000100:00100000:3.0:1789023934.492827:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789023934.492846:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422234752:12345-0@lo:101: 00010000:00010000:3.0:1789023934.492857:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023934.492879:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb34ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492906:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492918:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.492927:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4a00, rc 0) 00000100:00100000:3.0:1789023934.492956:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422234752:12345-0@lo:101: Request processed in 121us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023934.492962:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789023934.492991:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234752:0@lo:101: 00010000:00010000:3.0:1789023934.493003:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.493013:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023934.493063:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234880:0@lo:501: 00000100:00100000:3.0:1789023934.493087:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.493098:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023934.493109:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234880 00000100:00100000:3.0:1789023934.493112:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234880 00000100:00100000:3.0:1789023934.493128:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789023934.493133:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422234880:12345-0@lo:501: 00000100:00100000:3.0:1789023934.493228:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422234880:12345-0@lo:501: Request processed in 93us (139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023934.493247:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789023934.493288:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422234880:0@lo:501: 10000000:01000000:3.0:1789023934.493309:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789023934.493314:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023934.493321:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023934.494391:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422234496 00000100:00100000:0.0:1789023934.494417:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422234496 00000100:00100000:0.0:1789023934.494478:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023934.494486:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875927422234496:12345-0@lo:8: 00010000:00080000:0.0:1789023934.494518:0:8433:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1789023934.494548:0:8433:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb34bb 00002000:00100000:0.0:1789023934.494567:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90cc3d4b2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789023934.494583:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789023934.494585:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789023934.494658:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789023934.494686:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023934.494766:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422234496:12345-0@lo:8: Request processed in 279us (2676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023934.494774:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789023934.495448:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bc83800 x1875927422234496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.495459:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789023934.495468:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789023934.495475:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789023934.495481:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789023934.495483:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789023934.495912:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789023934.495920:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422234496:0@lo:8: 00000004:00080000:0.0:1789023934.497003:0:8901:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789023934.497083:0:8901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252532935668ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789023934.497090:0:8901:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789023934.506078:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789023934.506757:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023934.506788:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422235008:0@lo:13: 00000100:00100000:2.0:1789023934.507038:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789023934.507097:0:8902:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789023934.507124:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422235136:0@lo:7: 00000100:00100000:2.0:1789023934.507183:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.507235:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235136 00000100:00100000:2.0:1789023934.507244:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235136 00000100:00100000:2.0:1789023934.507318:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023934.507328:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8902:x1875927422235136:12345-0@lo:7: 00000100:00100000:1.0:1789023934.508318:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235008 00000100:00100000:1.0:1789023934.508328:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235008 00000100:00100000:1.0:1789023934.508679:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023934.508689:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422235008:12345-0@lo:13: 00002000:00000024:1.0:1789023934.508726:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789023934.509093:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422235008:12345-0@lo:13: Request processed in 405us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.509111:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789023934.509712:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d3100 x1875927422235008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.509737:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422235008:0@lo:13: 00000100:00080000:2.0:1789023934.510181:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023934.512417:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154ccc0 going to sleep for 11 seconds 00000004:00080000:3.0:1789023934.518710:0:8891:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789023934.518755:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235392:0@lo:7: 00000100:00100000:3.0:1789023934.518855:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.518910:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422235264:0@lo:13: 00000100:00100000:3.0:1789023934.518914:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3471f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.518947:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023934.518956:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789023934.518978:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789023934.519002:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235264 00000100:00100000:1.0:1789023934.519013:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235264 00000100:00100000:1.0:1789023934.519061:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023934.519070:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422235264:12345-0@lo:13: 00002000:00000024:1.0:1789023934.519098:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789023934.519168:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422235264:12345-0@lo:13: Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.519176:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023934.519209:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235392 00000100:00100000:3.0:1789023934.519212:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235392 00010000:00080000:1.0:1789023934.519222:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bc380 x1875927422235264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.519246:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422235264:0@lo:13: 00000100:00100000:3.0:1789023934.519322:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023934.519330:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422235392:12345-0@lo:7: 00002000:00080000:2.0:1789023934.528048:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789023934.528058:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:1.0:1789023934.542985:0:8902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d0e00 x1875927422235136/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.543009:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422235136:0@lo:7: 00000004:00080000:1.0:1789023934.543028:0:8902:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789023934.543063:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8902:x1875927422235136:12345-0@lo:7: Request processed in 35723us (35866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.543085:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023934.543089:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422235520:0@lo:5: 00000100:00100000:1.0:1789023934.543174:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.543244:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417780 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.545979:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235520 00000100:00100000:1.0:1789023934.546000:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235520 00000100:00100000:1.0:1789023934.546099:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023934.546111:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8902:x1875927422235520:12345-0@lo:5: 00002000:00080000:1.0:1789023934.546190:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789023934.546195:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:1.0:1789023934.553483:0:8904:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789023934.553495:0:8904:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789023934.553630:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422235392:12345-0@lo:7: Request processed in 34294us (34768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.553644:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789023934.553719:0:8891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bea00 x1875927422235392/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.553739:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235392:0@lo:7: 00000004:00080000:1.0:1789023934.553758:0:8891:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789023934.553830:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235648:0@lo:5: 00000100:00100000:1.0:1789023934.566015:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.566083:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.566121:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235648 00000100:00100000:1.0:1789023934.566132:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235648 00000100:00100000:1.0:1789023934.566218:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023934.566229:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422235648:12345-0@lo:5: 00002000:00080000:1.0:1789023934.566271:0:8904:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789023934.566318:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422235648:12345-0@lo:5: Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.566326:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789023934.566386:0:8891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fed80 x1875927422235648/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.566428:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235648:0@lo:5: 00000004:00080000:1.0:1789023934.566445:0:8891:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789023934.566923:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235776:0@lo:5: 00000100:00100000:1.0:1789023934.566963:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.566989:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023934.567004:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235776 00000100:00100000:1.0:1789023934.567008:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235776 00000100:00100000:1.0:1789023934.567042:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023934.567050:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8891:x1875927422235776:12345-0@lo:5: 00002000:00080000:1.0:1789023934.567084:0:8904:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:2.0:1789023934.574624:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789023934.574657:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789023934.575650:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8891:x1875927422235776:12345-0@lo:5: Request processed in 8592us (8678us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789023934.575666:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789023934.575956:0:8891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fed80 x1875927422235776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023934.575979:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8891:1875927422235776:0@lo:5: 00000004:00080000:2.0:1789023934.575999:0:8891:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1789023934.576057:0:8891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8891:1875927422235904:0@lo:900: 00000100:00100000:1.0:1789023934.578074:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8902:x1875927422235520:12345-0@lo:5: Request processed in 31955us (34889us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789023934.578092:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789023934.578186:0:8902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fc000 x1875927422235520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.578198:0:8902:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789023934.578205:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422235520:0@lo:5: 00000004:00080000:1.0:1789023934.578224:0:8902:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789023934.578281:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422236032:0@lo:700: 00000100:00100000:1.0:1789023934.578322:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023934.578376:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.578805:0:8891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023934.578966:0:8891:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023934.579001:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422235904 00000100:00100000:2.0:1789023934.579010:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422235904 00000100:00100000:2.0:1789023934.579072:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023934.579081:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8891:x1875927422235904:12345-0@lo:900: 00000100:00100000:2.0:1789023934.579170:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8891:x1875927422235904:12345-0@lo:900: Request processed in 89us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023934.579178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789023934.579217:0:8891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d1f80 x1875927422235904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023934.579228:0:8891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8891:1875927422235904:0@lo:900: 00000100:00100000:3.0:1789023934.579557:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236032 00000100:00100000:3.0:1789023934.579564:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236032 00000100:00100000:3.0:1789023934.579609:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023934.579618:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8902:x1875927422236032:12345-0@lo:700: 00000001:00080000:0.0:1789023934.607982:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1789023934.609897:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8902:x1875927422236032:12345-0@lo:700: Request processed in 30123us (31417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023934.609915:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789023934.610062:0:8902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9df80 x1875927422236032/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023934.610080:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422236032:0@lo:700: 00000004:02000040:0.0:1789023934.630440:0:8902:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789023934.640566:0:8902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422236160:0@lo:5: 00000100:00100000:1.0:1789023934.640655:0:8902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023934.640742:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236160 00000100:00100000:0.0:1789023934.640757:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236160 00000100:00100000:1.0:1789023934.640883:0:8902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023934.640921:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023934.640937:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8902:x1875927422236160:12345-0@lo:5: 00002000:00080000:2.0:1789023934.650755:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789023934.650787:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789023934.654709:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8902:x1875927422236160:12345-0@lo:5: Request processed in 13766us (14049us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789023934.654726:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789023934.656252:0:8902:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9ed80 x1875927422236160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023950 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023934.656272:0:8902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8902:1875927422236160:0@lo:5: 00000004:00080000:1.0:1789023934.656287:0:8902:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1789023935.308371:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789023935.665487:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1789023936.332467:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789023936.743087:0:8962:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023936.743642:0:8962:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789023936.908647:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023936.908683:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422236288:0@lo:41: 00000100:00100000:2.0:1789023936.908777:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023936.909114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236288 00000100:00100000:2.0:1789023936.909125:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236288 00000100:00100000:2.0:1789023936.909211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789023936.909220:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422236288:12345-0@lo:41: 00000004:00000024:2.0:1789023936.909265:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789023936.909318:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422236288:12345-0@lo:41: Request processed in 99us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023936.909326:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789023936.909391:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422236288:0@lo:41: 00010000:00010000:1.0:1789023937.364812:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789023937.843666:0:9010:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789023937.843679:0:9010:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789023938.380516:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023938.958875:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023938.958900:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422236416:0@lo:41: 00000100:00100000:3.0:1789023938.959024:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023938.959635:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236416 00000100:00100000:0.0:1789023938.959644:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236416 00000100:00100000:0.0:1789023938.959702:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789023938.959712:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422236416:12345-0@lo:41: 00000004:00000024:0.0:1789023938.959760:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789023938.959811:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422236416:12345-0@lo:41: Request processed in 100us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023938.959817:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023938.961163:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422236416:0@lo:41: 00010000:00010000:1.0:1789023939.405316:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023939.982168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422236544:0@lo:13: 00000100:00100000:3.0:1789023939.982241:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.982316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422236672:0@lo:400: 00000100:00100000:2.0:1789023939.982367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023939.982377:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422237056:0@lo:400: 00000100:00100000:2.0:1789023939.982401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422237184:0@lo:400: 00000100:00100000:3.0:1789023939.982411:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.982435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.982461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789023939.982467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422236800:0@lo:400: 00000100:00100000:2.0:1789023939.982489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.982506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422237312:0@lo:400: 00000100:00100000:2.0:1789023939.982535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.982572:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236672 00000100:00100000:2.0:1789023939.982579:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236672 00000100:00100000:2.0:1789023939.982632:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789023939.982642:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:3641:x1875927422236672:12345-0@lo:400: 00000100:00100000:2.0:1789023939.982694:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:3641:x1875927422236672:12345-0@lo:400: Request processed in 54us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.982701:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789023939.982735:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237184 00000100:00100000:2.0:1789023939.982739:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237184 00000100:00100000:2.0:1789023939.982766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789023939.982773:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422237184:12345-0@lo:400: 00000100:00100000:2.0:1789023939.982808:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422237184:12345-0@lo:400: Request processed in 37us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.982814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789023939.982834:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237056 00000100:00100000:2.0:1789023939.982837:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237056 00000100:00100000:2.0:1789023939.982880:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236800 00000100:00100000:2.0:1789023939.982883:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236800 00000100:00100000:2.0:1789023939.982900:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237312 00000100:00100000:2.0:1789023939.982903:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237312 00000100:00100000:1.0:1789023939.982921:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236544 00000100:00100000:1.0:1789023939.982926:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236544 00000100:00100000:2.0:1789023939.982938:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789023939.982947:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422237056:12345-0@lo:400: 00000100:00100000:1.0:1789023939.982963:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023939.982973:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422236544:12345-0@lo:13: 00000100:00100000:2.0:1789023939.982986:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422237056:12345-0@lo:400: Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.982994:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00002000:00000024:1.0:1789023939.982997:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023939.983010:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023939.983018:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422236800:12345-0@lo:400: 00000100:00100000:2.0:1789023939.983045:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422236800:12345-0@lo:400: Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.983051:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023939.983062:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023939.983068:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422237312:12345-0@lo:400: 00000100:00100000:2.0:1789023939.983092:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422237312:12345-0@lo:400: Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.983098:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1789023939.983124:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023939.983130:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023939.983142:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422237696:0@lo:13: 00000100:00100000:2.0:1789023939.983204:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789023939.983235:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d2d80 x1875927422236800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023939.983250:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422236800:0@lo:400: 00010000:00080000:2.0:1789023939.983261:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d1880 x1875927422237312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023939.983278:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422237312:0@lo:400: 00000100:00100000:2.0:1789023939.983290:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422236672:0@lo:400: 00000100:00100000:2.0:1789023939.983300:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422237184:0@lo:400: 00000100:00100000:2.0:1789023939.983359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422236928:0@lo:400: 00000100:00100000:3.0:1789023939.983383:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422237568:0@lo:400: 00000100:00100000:2.0:1789023939.983391:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.983416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422237440:0@lo:400: 00000100:00100000:3.0:1789023939.983424:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.985102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023939.985192:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422236928 00000100:00100000:2.0:1789023939.985201:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422236928 00000100:00100000:2.0:1789023939.985240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789023939.985251:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422236928:12345-0@lo:400: 00000100:00100000:1.0:1789023939.985306:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422236544:12345-0@lo:13: Request processed in 2333us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023939.985315:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422236928:12345-0@lo:400: Request processed in 66us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023939.985317:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023939.985327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023939.985339:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237696 00000100:00100000:1.0:1789023939.985355:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237696 00000100:00100000:1.0:1789023939.985388:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023939.985394:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422237696:12345-0@lo:13: 00002000:00000024:1.0:1789023939.985410:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023939.985466:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422237696:12345-0@lo:13: Request processed in 72us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023939.985472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023939.985491:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237440 00000100:00100000:1.0:1789023939.985495:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237440 00000100:00100000:1.0:1789023939.985533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789023939.985540:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422237440:12345-0@lo:400: 00000100:00100000:1.0:1789023939.985569:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422237440:12345-0@lo:400: Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023939.985574:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789023939.985595:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237568 00000100:00100000:1.0:1789023939.985599:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237568 00000100:00100000:1.0:1789023939.985621:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023939.985626:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422237568:12345-0@lo:400: 00000100:00100000:1.0:1789023939.985664:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422237568:12345-0@lo:400: Request processed in 37us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023939.985669:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789023939.985696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023939.985701:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023939.985729:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9d180 x1875927422237696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023939.985740:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789023939.985758:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422237696:0@lo:13: 00010000:00080000:3.0:1789023939.986273:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d0e00 x1875927422237568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023939.986285:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422237568:0@lo:400: 00010000:00080000:3.0:1789023939.986377:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bed80 x1875927422236544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023939.986384:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789023939.986399:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422236544:0@lo:13: 00010000:00080000:3.0:1789023939.986426:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d1180 x1875927422237056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023939.986434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422237056:0@lo:400: 00000100:00100000:1.0:1789023939.986619:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422236928:0@lo:400: 00010000:00080000:1.0:1789023939.986631:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb021d2300 x1875927422237440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023939.986640:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422237440:0@lo:400: 00010000:00010000:3.0:1789023940.428267:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023941.453538:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023942.029594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422237824:0@lo:41: 00000100:00100000:2.0:1789023942.029712:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023942.029787:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237824 00000100:00100000:2.0:1789023942.029796:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237824 00000100:00100000:2.0:1789023942.029839:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789023942.029848:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422237824:12345-0@lo:41: 00000004:00000024:2.0:1789023942.029883:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789023942.029942:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422237824:12345-0@lo:41: Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023942.029949:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789023942.030001:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422237824:0@lo:41: 00010000:00010000:3.0:1789023942.478362:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023943.506115:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023944.077424:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422237952:0@lo:41: 00000100:00100000:3.0:1789023944.077561:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023944.077686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422237952 00000100:00100000:3.0:1789023944.077698:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422237952 00000100:00100000:3.0:1789023944.077775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789023944.082273:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422237952:12345-0@lo:41: 00000004:00000024:3.0:1789023944.082367:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789023944.082506:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422237952:12345-0@lo:41: Request processed in 271us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023944.082517:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789023944.082980:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422237952:0@lo:41: 00010000:00010000:3.0:1789023944.524660:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023945.101632:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422238208:0@lo:400: 00000100:00100000:1.0:1789023945.101838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.101946:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422238720:0@lo:400: 00000100:00100000:1.0:1789023945.101995:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.102029:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422239232:0@lo:13: 00000100:00100000:1.0:1789023945.102065:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.102112:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789023945.102120:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422238336:0@lo:400: 00000100:00100000:1.0:1789023945.102195:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.102224:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422238848:0@lo:400: 00000100:00100000:1.0:1789023945.102253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.102324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238208 00000100:00100000:2.0:1789023945.102443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238720 00000100:00100000:2.0:1789023945.102515:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238720 00000100:00100000:2.0:1789023945.102573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238848 00000100:00100000:2.0:1789023945.102576:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238848 00000100:00100000:2.0:1789023945.102594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023945.102615:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422238720:12345-0@lo:400: 00000100:00100000:2.0:1789023945.102670:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422238720:12345-0@lo:400: Request processed in 69us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023945.102677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023945.102695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023945.102702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422238848:12345-0@lo:400: 00000100:00100000:2.0:1789023945.102733:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422238848:12345-0@lo:400: Request processed in 31us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023945.102739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023945.102898:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238208 00000100:00100000:1.0:1789023945.102944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023945.102952:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422238208:12345-0@lo:400: 00000100:00100000:1.0:1789023945.102987:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422238208:12345-0@lo:400: Request processed in 36us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023945.102993:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023945.103017:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239232 00000100:00100000:1.0:1789023945.103021:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239232 00000100:00100000:1.0:1789023945.103050:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023945.103056:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422239232:12345-0@lo:13: 00002000:00000024:1.0:1789023945.103079:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023945.103111:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422239232:12345-0@lo:13: Request processed in 56us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023945.103132:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023945.103178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238336 00000100:00100000:1.0:1789023945.103182:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238336 00000100:00100000:1.0:1789023945.103222:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023945.103229:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422238336:12345-0@lo:400: 00000100:00100000:3.0:1789023945.103580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422238080:0@lo:400: 00000100:00100000:2.0:1789023945.103807:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422239360:0@lo:13: 00000100:00100000:2.0:1789023945.104244:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.104535:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422238336:12345-0@lo:400: Request processed in 1305us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023945.104545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789023945.104575:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023945.104580:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023945.104583:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023945.104687:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422238336:0@lo:400: 00010000:00080000:1.0:1789023945.104701:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc30c16a00 x1875927422238848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023945.104712:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422238848:0@lo:400: 00010000:00080000:1.0:1789023945.104723:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9ed80 x1875927422238208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023945.104734:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422238208:0@lo:400: 00010000:00080000:1.0:1789023945.104746:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc2d0fc000 x1875927422238720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023945.104752:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422238720:0@lo:400: 00010000:00080000:1.0:1789023945.104761:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc30c15180 x1875927422239232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023945.104775:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422239232:0@lo:13: 00000100:00100000:1.0:1789023945.104828:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239360 00000100:00100000:1.0:1789023945.104835:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239360 00000100:00100000:3.0:1789023945.104848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023945.104921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422238592:0@lo:400: 00000100:00100000:1.0:1789023945.104929:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023945.104939:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422239360:12345-0@lo:13: 00002000:00000024:1.0:1789023945.104957:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023945.105007:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422239360:12345-0@lo:13: Request processed in 69us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023945.105014:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789023945.105057:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bed80 x1875927422239360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023945.105072:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023945.105081:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422239360:0@lo:13: 00000100:00100000:3.0:1789023945.105114:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422239104:0@lo:400: 00000100:00100000:3.0:1789023945.105174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023945.105211:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789023945.105219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422238464:0@lo:400: 00000100:00100000:3.0:1789023945.105249:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023945.105275:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422238976:0@lo:400: 00000100:00100000:3.0:1789023945.106416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023945.107011:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238592 00000100:00100000:3.0:1789023945.107023:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238592 00000100:00100000:3.0:1789023945.107084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789023945.107098:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422238592:12345-0@lo:400: 00000100:00100000:3.0:1789023945.107242:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422238592:12345-0@lo:400: Request processed in 148us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023945.107250:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789023945.107282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238080 00000100:00100000:3.0:1789023945.107286:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238080 00000100:00100000:3.0:1789023945.108259:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789023945.108270:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422238080:12345-0@lo:400: 00000100:00100000:3.0:1789023945.108358:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422238080:12345-0@lo:400: Request processed in 88us (3516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023945.108365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789023945.108421:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239104 00000100:00100000:3.0:1789023945.108429:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239104 00000100:00100000:3.0:1789023945.108461:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238976 00000100:00100000:3.0:1789023945.108477:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238976 00000100:00100000:3.0:1789023945.108502:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023945.108509:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422239104:12345-0@lo:400: 00000100:00100000:3.0:1789023945.108547:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422239104:12345-0@lo:400: Request processed in 39us (3374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023945.108554:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023945.108566:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023945.108572:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422238976:12345-0@lo:400: 00000100:00100000:3.0:1789023945.108604:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422238976:12345-0@lo:400: Request processed in 32us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023945.108609:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789023945.108696:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc30c17480 x1875927422238976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023945.108714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422238976:0@lo:400: 00000100:00100000:3.0:1789023945.108728:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422238080:0@lo:400: 00000100:00080000:2.0:1789023945.108803:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023945.109238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422238464 00000100:00100000:2.0:1789023945.109250:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422238464 00000100:00100000:2.0:1789023945.109542:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023945.109557:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422238464:12345-0@lo:400: 00000100:00100000:2.0:1789023945.109747:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422238464:12345-0@lo:400: Request processed in 195us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023945.109755:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023945.110214:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422238592:0@lo:400: 00010000:00080000:3.0:1789023945.110250:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc30c14700 x1875927422239104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023945.110279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422239104:0@lo:400: 00010000:00080000:3.0:1789023945.111062:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9df80 x1875927422238464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023945.111077:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422238464:0@lo:400: 00010000:00010000:0.0:1789023945.549949:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023946.572298:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023947.148442:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023947.148470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422239488:0@lo:41: 00000100:00100000:0.0:1789023947.148545:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.148933:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239488 00000100:00100000:1.0:1789023947.148943:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239488 00000100:00100000:1.0:1789023947.149000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789023947.149010:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422239488:12345-0@lo:41: 00000004:00000024:1.0:1789023947.149043:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789023947.149136:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422239488:12345-0@lo:41: Request processed in 127us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.149143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789023947.149327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422239488:0@lo:41: 00010000:00010000:0.0:1789023947.612602:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789023947.645990:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789023947.645996:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789023947.645998:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789023947.646187:0:9509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cb021fb800 00000020:01000004:3.0:1789023947.646207:0:9509:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789023947.646238:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789023947.646258:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90cb020ab380) 00000020:00000080:3.0:1789023947.646289:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789023947.717752:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789023947.717833:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789023947.768907:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789023947.769740:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789023947.769761:0:9509:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789023947.769779:0:9509:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa736ef4b98cb34c9 00000020:01000004:3.0:1789023947.769787:0:9509:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789023947.769816:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789023947.769820:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789023947.769832:0:9509:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789023947.769868:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789023947.769873:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789023947.797849:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789023947.797907:0:9509:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.118@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789023947.797912:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789023947.797915:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789023947.797916:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023947.797917:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023947.797919:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023947.797920:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023947.797921:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023947.797924:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023947.797929:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023947.797931:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023947.797932:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023947.797937:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789023947.797939:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789023947.797941:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789023947.797941:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023947.797942:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023947.797943:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023947.797944:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023947.797945:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023947.797946:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023947.797946:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023947.797947:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023947.797948:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023947.797986:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789023947.798012:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422239616:0@lo:253: 00000100:00100000:1.0:1789023947.798111:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.798697:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.798749:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239616 00000100:00100000:3.0:1789023947.798760:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239616 00000100:00100000:3.0:1789023947.798866:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789023947.798878:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:9509:x1875927422239616:12345-0@lo:253: 20000000:01000000:3.0:1789023947.798935:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789023947.798940:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789023947.798947:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789023947.798951:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789023947.799450:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023947.799626:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789023947.799643:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789023947.799660:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789023947.799666:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789023947.799693:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789023947.799711:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789023947.799820:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789023947.799839:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023947.799842:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023947.799857:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789023947.799863:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023947.799878:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789023947.799884:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023947.799894:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789023947.799901:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789023947.799912:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789023947.799924:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789023947.799998:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789023947.800008:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023947.800010:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023947.800025:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789023947.800030:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023947.800041:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789023947.800046:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023947.800058:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789023947.800073:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789023947.800089:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789023947.800106:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789023947.801011:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789023947.801032:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.118@tcp 20000000:01000000:3.0:1789023947.801034:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.118@tcp (null) (null) (null) 00000040:00080000:3.0:1789023947.801051:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789023947.801056:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789023947.801090:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789023947.801096:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.118@tcp (null) (null) 00000040:00080000:3.0:1789023947.801107:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789023947.801113:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789023947.801122:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789023947.801134:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789023947.801465:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789023947.801469:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789023947.801473:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789023947.801576:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023947.801579:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789023947.802002:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1789023947.802039:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1789023947.802055:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789023947.802526:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789023947.802549:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789023947.802565:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789023947.802578:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789023947.802580:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789023947.802942:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1789023947.802974:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1789023947.802986:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789023947.807814:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789023947.807871:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789023947.807889:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1789023947.807915:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789023947.807919:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789023947.808765:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1789023947.808801:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1789023947.808817:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1789023947.809080:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1789023947.809103:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1789023947.809117:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1789023947.809130:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789023947.809132:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789023947.809848:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789023947.810064:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789023947.810089:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789023947.810122:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789023947.810134:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789023947.810136:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789023947.810940:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789023947.810971:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789023947.810988:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789023947.811287:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789023947.811309:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789023947.811322:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1789023947.811339:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789023947.811365:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811386:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811394:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811400:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811406:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811413:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811419:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811425:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811432:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811487:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811502:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.811520:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422239744:0@lo:104: 00000100:00100000:2.0:1789023947.811609:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.811823:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.811832:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.811840:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422239872:0@lo:104: 00000100:00100000:2.0:1789023947.811864:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.812001:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812009:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 21 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.812017:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240000:0@lo:104: 00000100:00100000:2.0:1789023947.812039:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.812091:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239744 00000100:00100000:3.0:1789023947.812100:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239744 00000100:00100000:3.0:1789023947.812142:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422239872 00000100:00100000:3.0:1789023947.812214:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422239872 00000100:00100000:3.0:1789023947.812234:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023947.812243:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6508:x1875927422239744:12345-0@lo:104: 00010000:00010000:3.0:1789023947.812258:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812418:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812427:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 21 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.812451:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240128:0@lo:104: 00000100:00100000:2.0:1789023947.812476:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.812496:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812503:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.812510:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240256:0@lo:104: 00000100:00100000:2.0:1789023947.812528:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.812563:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812571:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.812580:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240384:0@lo:104: 00000100:00100000:2.0:1789023947.812606:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.812623:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.812631:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 21 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.812639:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240512:0@lo:104: 00000100:00100000:2.0:1789023947.812659:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023947.812686:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422239744:0@lo:104: 00010000:00010000:3.0:1789023947.812782:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023947.812790:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6508:x1875927422239744:12345-0@lo:104: Request processed in 547us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.812798:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023947.812825:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789023947.812842:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.812850:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240000 00000100:00100000:3.0:1789023947.812853:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240000 00000100:00100000:3.0:1789023947.812865:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240128 00000100:00100000:3.0:1789023947.812867:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240128 00000100:00100000:3.0:1789023947.812874:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240256 00000100:00100000:3.0:1789023947.812876:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240256 00000100:00100000:3.0:1789023947.812883:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240384 00000100:00100000:3.0:1789023947.812885:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240384 00000100:00100000:3.0:1789023947.812892:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240512 00000100:00100000:3.0:1789023947.812894:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240512 00000100:00100000:3.0:1789023947.812903:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023947.812908:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+8:6508:x1875927422239872:12345-0@lo:104: 00010000:00010000:3.0:1789023947.812917:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.813076:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422239872:0@lo:104: 00010000:00010000:1.0:1789023947.813119:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023947.813128:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813137:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023947.813141:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813249:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023947.813257:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023947.813269:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023947.813346:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813354:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023947.813379:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813387:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4600/0xa736ef4b98cb34ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34b4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813399:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023947.813403:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813409:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023947.813412:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.813419:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023947.813425:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023947.813431:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.813469:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789023947.813481:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+8:6508:x1875927422239872:12345-0@lo:104: Request processed in 572us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.813488:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023947.813523:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023947.813535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422240640:0@lo:103: 00000100:00100000:3.0:1789023947.813568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023947.813604:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023947.813621:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240640 00000100:00100000:3.0:1789023947.813626:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240640 00010000:00010000:3.0:1789023947.813649:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023947.813672:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023947.813679:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+22:3643:x1875927422240640:12345-0@lo:103: 00010000:00010000:3.0:1789023947.813692:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023947.813698:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.813819:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.813835:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb34b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb34ad expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.813848:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023947.813887:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3643:x1875927422240640:12345-0@lo:103: Request processed in 209us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.813894:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023947.813955:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422240640:0@lo:103: 00000100:00100000:2.0:1789023947.814018:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789023947.814027:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+7:6508:x1875927422240000:12345-0@lo:104: 00010000:00010000:2.0:1789023947.814036:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.814122:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023947.814127:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+7:6508:x1875927422240000:12345-0@lo:104: Request processed in 103us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.814132:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789023947.814169:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789023947.814176:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:6508:x1875927422240128:12345-0@lo:104: 00010000:00010000:2.0:1789023947.814184:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.814225:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789023947.814230:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:6508:x1875927422240128:12345-0@lo:104: Request processed in 56us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.814236:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789023947.814249:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789023947.814255:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:6508:x1875927422240256:12345-0@lo:104: 00010000:00010000:2.0:1789023947.814263:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.814301:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789023947.814306:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:6508:x1875927422240256:12345-0@lo:104: Request processed in 52us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.814311:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789023947.814330:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789023947.814336:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c18e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6508:x1875927422240384:12345-0@lo:104: 00010000:00010000:2.0:1789023947.814344:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.814372:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789023947.814377:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c18e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:6508:x1875927422240384:12345-0@lo:104: Request processed in 42us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.814382:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789023947.814410:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789023947.814416:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6508:x1875927422240512:12345-0@lo:104: 00010000:00010000:2.0:1789023947.814424:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.814451:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789023947.814455:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:6508:x1875927422240512:12345-0@lo:104: Request processed in 40us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.814460:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789023947.815979:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789023947.816256:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789023947.816296:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816310:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.816314:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816326:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.816334:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.816340:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.816392:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816399:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.816429:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816437:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb346e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3475 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816452:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789023947.816455:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816461:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.816465:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816486:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.816492:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.816497:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.816511:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816517:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.816523:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816529:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00031200/0xa736ef4b98cb3428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb342f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816540:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789023947.816543:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816549:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.816552:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816559:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.816565:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.816576:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.816590:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816596:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.816619:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816627:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb33e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33f0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816637:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023947.816640:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816645:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.816648:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816654:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.816661:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.816666:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.816679:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816685:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.816697:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816704:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a161200/0xa736ef4b98cb33bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33c6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.816792:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.816795:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.816797:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023947.817033:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240000:0@lo:104: 00000100:00100000:0.0:1789023947.817054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241024:0@lo:103: 00000100:00100000:0.0:1789023947.817126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.817194:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023947.817201:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241152:0@lo:103: 00000100:00100000:0.0:1789023947.817228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.817267:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241024 00000100:00100000:0.0:1789023947.817286:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241024 00010000:00010000:0.0:1789023947.817320:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.817350:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241152 00000100:00100000:0.0:1789023947.817353:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241152 00010000:00010000:0.0:1789023947.817363:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 22 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.817383:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023947.817395:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+22:3643:x1875927422241024:12345-0@lo:103: 00010000:00010000:0.0:1789023947.817411:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.817417:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.817427:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 22 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.817447:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.817481:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+22:3643:x1875927422241024:12345-0@lo:103: Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.817488:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023947.817507:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023947.817513:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+21:3643:x1875927422241152:12345-0@lo:103: 00010000:00010000:0.0:1789023947.817520:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.817525:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 21 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.817545:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 21 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.817556:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.817579:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+21:3643:x1875927422241152:12345-0@lo:103: Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.817585:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023947.817625:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241152:0@lo:103: 00000100:00100000:0.0:1789023947.817633:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241024:0@lo:103: 00000100:00100000:0.0:1789023947.817662:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240128:0@lo:104: 00000100:00100000:0.0:1789023947.817672:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240256:0@lo:104: 00010000:00010000:0.0:1789023947.817681:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb33f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb33e9 expref: 20 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.817693:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240384:0@lo:104: 00010000:00010000:0.0:1789023947.817703:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb33c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb33bf expref: 19 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.818212:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023947.818217:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023947.818219:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023947.818334:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422240896:0@lo:103: 00000100:00100000:2.0:1789023947.818385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.818430:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023947.818436:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422240768:0@lo:103: 00000100:00100000:2.0:1789023947.818459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.818572:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875927422240512:0@lo:104: 00010000:00010000:0.0:1789023947.818618:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.818637:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240896 00000100:00100000:0.0:1789023947.818643:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240896 00010000:00010000:0.0:1789023947.818668:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 19 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.818907:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.818918:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.818923:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.818931:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.818937:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.818943:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.818981:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.818988:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.819006:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.819012:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5000/0xa736ef4b98cb3444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb344b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023947.819041:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422241280:0@lo:103: 00000100:00100000:3.0:1789023947.819078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.819561:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422240768 00000100:00100000:0.0:1789023947.819568:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422240768 00010000:00010000:0.0:1789023947.819592:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 20 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.819608:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241280 00000100:00100000:0.0:1789023947.819611:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241280 00010000:00010000:0.0:1789023947.819624:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 21 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.819637:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023947.819645:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+21:3642:x1875927422240896:12345-0@lo:103: 00010000:00010000:0.0:1789023947.819658:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.819663:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819674:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819688:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5200/0xa736ef4b98cb342f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3428 expref: 21 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819700:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.819755:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f197050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+20:3642:x1875927422240896:12345-0@lo:103: Request processed in 109us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.819763:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023947.819815:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789023947.819821:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+19:3642:x1875927422240768:12345-0@lo:103: 00010000:00010000:0.0:1789023947.819840:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.819845:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 19 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819853:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 19 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819864:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb3475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb346e expref: 19 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819872:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.819894:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+18:3642:x1875927422240768:12345-0@lo:103: Request processed in 73us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.819900:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789023947.819910:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023947.819915:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422241280:12345-0@lo:103: 00010000:00010000:0.0:1789023947.819921:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.819925:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 17 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819933:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 17 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819941:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb344b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3444 expref: 17 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.819949:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.819972:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+16:3641:x1875927422241280:12345-0@lo:103: Request processed in 56us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.819977:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023947.820021:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422240768:0@lo:103: 00000100:00100000:0.0:1789023947.820029:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422240896:0@lo:103: 00000100:00100000:0.0:1789023947.820050:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422241280:0@lo:103: 00010000:00010000:3.0:1789023947.820189:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.820192:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.820194:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023947.820270:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820289:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023947.820314:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820322:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01489800/0xa736ef4b98cb348a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3491 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.820343:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023947.820353:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422241408:0@lo:103: 00000100:00100000:0.0:1789023947.820382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.820409:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241408 00000100:00100000:0.0:1789023947.820413:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241408 00010000:00010000:0.0:1789023947.820430:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 16 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.820448:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023947.820454:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+16:3641:x1875927422241408:12345-0@lo:103: 00010000:00010000:0.0:1789023947.820460:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023947.820464:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 16 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820473:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 16 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820491:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb348a expref: 16 pid: 6509 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820504:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820514:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820531:0:7924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820539:0:7924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820547:0:7924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820555:0:7924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820561:0:7924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789023947.820567:0:7924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820576:0:7924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820590:0:7924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820611:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023947.820639:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+15:3641:x1875927422241408:12345-0@lo:103: Request processed in 185us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.820646:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023947.820673:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422241408:0@lo:103: 00010000:00010000:0.0:1789023947.820686:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023947.820688:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023947.820690:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023947.820697:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820931:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.820941:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb34d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789023947.820955:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789023947.825133:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+14:9509:x1875927422239616:12345-0@lo:253: Request processed in 26243us (27007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.825188:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789023947.825357:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422239616:0@lo:253: 10000000:01000000:0.0:1789023947.825383:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789023947.825387:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023947.825389:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789023947.825391:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023947.825392:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789023947.825394:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023947.825395:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023947.825397:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023947.825398:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789023947.825401:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023947.825402:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789023947.825437:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cb021fb800 from lustre-OST0001 10000000:01000000:0.0:1789023947.825479:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789023947.825482:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789023947.825493:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cc339999c0 local copy 10000000:01000000:0.0:1789023947.825498:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789023947.825550:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.825563:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.825573:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023947.825595:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241536:0@lo:101: 00000100:00100000:0.0:1789023947.825642:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.825698:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.825716:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241536 00000100:00100000:3.0:1789023947.825726:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241536 00000100:00100000:3.0:1789023947.825786:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789023947.825798:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+14:9509:x1875927422241536:12345-0@lo:101: 00010000:00010000:3.0:1789023947.825817:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023947.825835:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb34de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb34d7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.825866:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb34de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb34d7 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.825880:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb34de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb34d7 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.825891:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789023947.825949:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422241536:12345-0@lo:101: Request processed in 153us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.825956:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789023947.826039:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241536:0@lo:101: 00010000:00010000:1.0:1789023947.826056:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826066:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.826357:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241664:0@lo:501: 00000100:00100000:1.0:1789023947.826395:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.826433:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023947.826446:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241664 00000100:00100000:0.0:1789023947.826452:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241664 00000100:00100000:0.0:1789023947.826529:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789023947.826538:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422241664:12345-0@lo:501: 00000100:00100000:0.0:1789023947.826616:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422241664:12345-0@lo:501: Request processed in 78us (222us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023947.826623:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789023947.826726:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241664:0@lo:501: 10000000:01000000:1.0:1789023947.826741:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789023947.826760:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789023947.826766:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826776:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826785:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826812:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789023947.826847:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cb021fb800 10000000:01000000:1.0:1789023947.826852:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789023947.826859:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789023947.826861:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023947.826866:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789023947.826882:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789023947.826902:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826910:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.826920:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.826934:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241792:0@lo:101: 00000100:00100000:1.0:1789023947.826962:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.826990:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00010000:00010000:3.0:1789023947.827040:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023947.827050:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827059:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023947.827071:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827080:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.827088:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.827095:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023947.827118:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827126:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.827206:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827214:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb34d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa736ef4b98cb34de expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827228:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.827230:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.827232:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023947.827358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241920:0@lo:103: 00000100:00100000:1.0:1789023947.827393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.827706:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241920 00000100:00100000:3.0:1789023947.827714:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241920 00000100:00100000:3.0:1789023947.827769:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023947.827779:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+15:3643:x1875927422241920:12345-0@lo:103: 00010000:00010000:3.0:1789023947.827794:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023947.827813:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb34de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb34d7 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.827845:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023947.827888:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+14:3643:x1875927422241920:12345-0@lo:103: Request processed in 111us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.827896:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023947.827968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422241920:0@lo:103: 00000100:00100000:2.0:1789023947.828120:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422241792 00000100:00100000:2.0:1789023947.828126:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422241792 00000100:00100000:2.0:1789023947.828206:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789023947.828217:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+14:9509:x1875927422241792:12345-0@lo:101: 00010000:00010000:2.0:1789023947.828241:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023947.828261:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb34e5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.828293:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.828305:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.828312:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1000, rc 0) 00000100:00100000:2.0:1789023947.828356:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422241792:12345-0@lo:101: Request processed in 144us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.828363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789023947.828390:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422241792:0@lo:101: 00010000:00010000:1.0:1789023947.828407:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.828417:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.828519:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242048:0@lo:501: 00000100:00100000:1.0:1789023947.828551:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.828584:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.828696:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242048 00000100:00100000:3.0:1789023947.828701:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242048 00000100:00100000:3.0:1789023947.828735:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789023947.828743:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242048:12345-0@lo:501: 00000100:00100000:3.0:1789023947.828871:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242048:12345-0@lo:501: Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.828879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789023947.828941:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242048:0@lo:501: 00000100:00100000:1.0:1789023947.828970:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242176:0@lo:503: 00000100:00100000:1.0:1789023947.829851:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.829894:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.830079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242176 00000100:00100000:3.0:1789023947.830088:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242176 00000100:00100000:3.0:1789023947.830141:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789023947.830232:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242176:12345-0@lo:503: 00000100:00100000:3.0:1789023947.830371:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242176:12345-0@lo:503: Request processed in 143us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.830379:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789023947.830513:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242176:0@lo:503: 00000040:00080000:1.0:1789023947.830935:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023947.831053:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242304:0@lo:502: 00000100:00100000:1.0:1789023947.831105:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.831575:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023947.831607:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242304 00000100:00100000:0.0:1789023947.831615:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242304 00000100:00100000:0.0:1789023947.831673:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789023947.831685:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242304:12345-0@lo:502: 00000100:00100000:0.0:1789023947.832086:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242304:12345-0@lo:502: Request processed in 404us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.832103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789023947.832666:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242304:0@lo:502: 00000040:00080000:1.0:1789023947.834979:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789023947.835070:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789023947.835085:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789023947.835097:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789023947.835111:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789023947.835123:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789023947.835944:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242432:0@lo:502: 00000100:00100000:0.0:1789023947.836068:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.836125:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.836752:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242432 00000100:00100000:3.0:1789023947.836765:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242432 00000100:00100000:3.0:1789023947.836842:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789023947.836854:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242432:12345-0@lo:502: 00000100:00100000:3.0:1789023947.837044:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242432:12345-0@lo:502: Request processed in 191us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.837054:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789023947.837242:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242432:0@lo:502: 00000040:00080000:0.0:1789023947.837357:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789023947.837374:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789023947.839823:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023947.839841:0:9522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789023947.839849:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023947.839852:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789023947.839859:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023947.839897:0:9522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90cb0261cd40) 00000020:00000080:0.0:1789023947.839934:0:9522:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789023947.839944:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023947.840037:0:9522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb021fb800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789023947.840048:0:9522:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789023947.840056:0:9522:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa736ef4b98cb34fa 00010000:00010000:0.0:1789023947.846435:0:9522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1789023947.846805:0:9522:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789023947.850696:0:9522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789023947.851444:0:9522:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789023947.857035:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789023947.857288:0:9522:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789023947.866037:0:9522:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789023947.871791:0:9522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789023947.871818:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023947.871827:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023947.871830:0:9522:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789023947.871833:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023947.871838:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023947.871840:0:9522:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023947.871843:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023947.871845:0:9522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789023947.871885:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023947.871888:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023947.871890:0:9522:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023947.871894:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789023947.873214:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789023947.873282:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789023947.873315:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.873332:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.873377:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb021fb800 from 1 10000000:01000000:3.0:1789023947.873382:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023947.873438:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.873448:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.873463:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023947.873494:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242560:0@lo:101: 00000100:00100000:3.0:1789023947.873597:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.873661:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc055143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023947.873724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242560 00000100:00100000:0.0:1789023947.873736:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242560 00000100:00100000:0.0:1789023947.873803:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789023947.873815:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:9509:x1875927422242560:12345-0@lo:101: 00010000:00010000:0.0:1789023947.873834:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023947.873864:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3501 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.873896:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.873909:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023947.873919:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489e00, rc 0) 00000100:00100000:0.0:1789023947.873987:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242560:12345-0@lo:101: Request processed in 174us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.873993:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789023947.874106:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242560:0@lo:101: 00010000:00010000:2.0:1789023947.874125:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.874187:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.874360:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242688:0@lo:501: 00000100:00100000:2.0:1789023947.874416:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.874455:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.874469:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242688 00000100:00100000:3.0:1789023947.874475:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242688 00000100:00100000:3.0:1789023947.874512:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789023947.874520:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242688:12345-0@lo:501: 00000100:00100000:3.0:1789023947.874657:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242688:12345-0@lo:501: Request processed in 136us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.874673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789023947.874677:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242688:0@lo:501: 00000100:00100000:2.0:1789023947.874722:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242816:0@lo:503: 00000100:00100000:2.0:1789023947.874983:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.875049:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.876648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242816 00000100:00100000:3.0:1789023947.876838:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242816 00000100:00100000:3.0:1789023947.877087:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789023947.877099:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242816:12345-0@lo:503: 00000100:00100000:3.0:1789023947.877369:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242816:12345-0@lo:503: Request processed in 264us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.877386:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789023947.877424:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242816:0@lo:503: 00000040:00080000:1.0:1789023947.877975:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023947.878073:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242944:0@lo:502: 00000100:00100000:1.0:1789023947.878377:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.879928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422242944 00000100:00100000:1.0:1789023947.879974:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023947.881800:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422242944 00000100:00100000:2.0:1789023947.883629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789023947.883908:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242944:12345-0@lo:502: 00000100:00100000:2.0:1789023947.884195:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422242944:12345-0@lo:502: Request processed in 541us (5818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.884205:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789023947.884296:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422242944:0@lo:502: 00000040:00080000:1.0:1789023947.884875:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789023947.884909:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789023947.884952:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243072:0@lo:502: 00000100:00100000:1.0:1789023947.885028:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.885075:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023947.885163:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243072 00000100:00100000:0.0:1789023947.885177:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243072 00000100:00100000:0.0:1789023947.885248:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789023947.885263:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422243072:12345-0@lo:502: 00000100:00100000:0.0:1789023947.885420:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422243072:12345-0@lo:502: Request processed in 161us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.885428:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789023947.885457:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243072:0@lo:502: 00000040:00080000:1.0:1789023947.885578:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789023947.885587:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789023947.886646:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023947.886663:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023947.886666:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789023947.886674:0:9526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb021fb800 00000020:00000080:2.0:1789023947.886677:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789023947.886690:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023947.886692:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023947.886693:0:9526:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789023947.886696:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789023947.886868:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789023947.886902:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023947.886931:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.886944:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023947.887004:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789023947.887007:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cb021fb800 10000000:01000000:1.0:1789023947.887011:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cb021fb800 10000000:01000000:1.0:1789023947.887015:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023947.887022:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cb021fb800 from 1 10000000:01000000:1.0:1789023947.887025:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023947.887068:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.887077:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.887088:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.887112:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243200:0@lo:101: 00000100:00100000:1.0:1789023947.887216:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.887261:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.887296:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243200 00000100:00100000:3.0:1789023947.887306:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243200 00000100:00100000:3.0:1789023947.887406:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789023947.887418:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:9509:x1875927422243200:12345-0@lo:101: 00010000:00010000:3.0:1789023947.887434:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023947.887450:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb350f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.887479:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.887492:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.887502:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5000, rc 0) 00000100:00100000:3.0:1789023947.887561:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243200:12345-0@lo:101: Request processed in 146us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.887568:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789023947.887613:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243200:0@lo:101: 00010000:00010000:2.0:1789023947.887635:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.887642:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.887726:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243328:0@lo:501: 00000100:00100000:2.0:1789023947.887755:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.892385:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023947.892820:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243328 00000100:00100000:1.0:1789023947.892921:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243328 00000100:00100000:1.0:1789023947.893052:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789023947.893064:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243328:12345-0@lo:501: 00000100:00100000:1.0:1789023947.893401:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243328:12345-0@lo:501: Request processed in 337us (5642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.893411:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789023947.893647:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243328:0@lo:501: 00000100:00100000:2.0:1789023947.893725:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243456:0@lo:503: 00000100:00100000:2.0:1789023947.893929:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.893971:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023947.894180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243456 00000100:00100000:0.0:1789023947.894188:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243456 00000100:00100000:0.0:1789023947.894239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789023947.894249:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243456:12345-0@lo:503: 00000100:00100000:0.0:1789023947.894388:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243456:12345-0@lo:503: Request processed in 141us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.894395:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789023947.894416:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243456:0@lo:503: 00000040:00080000:1.0:1789023947.894750:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023947.894845:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243584:0@lo:502: 00000100:00100000:1.0:1789023947.894898:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023947.894938:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.895479:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243584 00000100:00100000:3.0:1789023947.895487:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243584 00000100:00100000:3.0:1789023947.895542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789023947.895551:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243584:12345-0@lo:502: 00000100:00100000:3.0:1789023947.895693:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243584:12345-0@lo:502: Request processed in 142us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.895700:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789023947.895926:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243584:0@lo:502: 00000040:00080000:1.0:1789023947.898109:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789023947.898566:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789023947.898586:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789023947.898602:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789023947.898618:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789023947.898653:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789023947.898668:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789023947.898754:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789023947.898769:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789023947.898781:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789023947.898793:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789023947.898807:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789023947.898819:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789023947.898832:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789023947.898847:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789023947.898928:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789023947.898997:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789023947.899022:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789023947.899034:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789023947.899049:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789023947.899061:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789023947.899089:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789023947.899104:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789023947.899116:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789023947.899129:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789023947.899140:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789023947.899317:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789023947.899411:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789023947.899442:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789023947.899472:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789023947.899486:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789023947.899500:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789023947.899514:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789023947.899529:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789023947.899542:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789023947.899556:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789023947.899568:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789023947.899598:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789023947.899616:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789023947.899629:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789023947.899641:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789023947.899668:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789023947.899684:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789023947.899698:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789023947.899711:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789023947.899725:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789023947.900102:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243712:0@lo:502: 00000100:00100000:0.0:1789023947.900259:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.900335:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c3b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023947.900357:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243712 00000100:00100000:2.0:1789023947.900368:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243712 00000100:00100000:2.0:1789023947.900441:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789023947.900455:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243712:12345-0@lo:502: 00000100:00100000:2.0:1789023947.900619:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422243712:12345-0@lo:502: Request processed in 168us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.900630:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789023947.901919:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422243712:0@lo:502: 00000040:00080000:3.0:1789023947.902062:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1789023947.902083:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789023947.903572:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789023947.903596:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90cc344ecd40) 00000020:00000080:1.0:1789023947.903631:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789023947.904210:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb021fb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789023947.904216:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cb021fb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789023947.904220:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb021fb800 3 00010000:00080000:0.0:1789023947.904267:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3bf9b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789023947.908317:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789023947.908612:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789023947.912033:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789023947.912077:0:9527:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa736ef4b98cb3524 00000100:00080000:0.0:1789023947.912093:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023947.912110:0:9527:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90cc3bf9b000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789023947.912182:0:9527:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bc80e00 x1875927422243840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023947.912244:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789023947.912302:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422243840:0@lo:38: 00000100:00100000:2.0:1789023947.912415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.912630:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422244096:0@lo:400: 00000100:00100000:3.0:1789023947.912661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.912698:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422244608:0@lo:400: 00000100:00100000:3.0:1789023947.912724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.912743:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789023947.912748:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422244224:0@lo:400: 00000100:00100000:3.0:1789023947.912770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.912785:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422244736:0@lo:400: 00000100:00100000:3.0:1789023947.912802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.912834:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244608 00000100:00100000:3.0:1789023947.912843:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244608 00000100:00100000:3.0:1789023947.913072:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244736 00000100:00100000:3.0:1789023947.913076:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244736 00000100:00100000:3.0:1789023947.913104:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023947.913112:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422244608:12345-0@lo:400: 00000100:00100000:3.0:1789023947.913204:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422244608:12345-0@lo:400: Request processed in 92us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.913212:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023947.913229:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023947.913243:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422244736:12345-0@lo:400: 00000100:00100000:3.0:1789023947.913283:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422244736:12345-0@lo:400: Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.913289:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023947.913312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244224 00000100:00100000:3.0:1789023947.913315:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244224 00000100:00100000:3.0:1789023947.913340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789023947.913346:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422244224:12345-0@lo:400: 00000100:00100000:2.0:1789023947.913681:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422243968:0@lo:400: 00000100:00100000:2.0:1789023947.913720:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.913744:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422244480:0@lo:400: 00000100:00100000:2.0:1789023947.913767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.913797:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023947.913804:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422244352:0@lo:400: 00000100:00100000:2.0:1789023947.913825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.913849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243840 00000100:00100000:2.0:1789023947.913852:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243840 00000100:00100000:1.0:1789023947.914122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244096 00000100:00100000:1.0:1789023947.914128:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244096 00000100:00100000:1.0:1789023947.914196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422243968 00000100:00100000:1.0:1789023947.914199:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422243968 00000100:00100000:1.0:1789023947.914215:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244480 00000100:00100000:1.0:1789023947.914217:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244480 00000100:00100000:0.0:1789023947.914221:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244352 00000100:00100000:0.0:1789023947.914228:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244352 00000100:00100000:1.0:1789023947.914244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023947.914255:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422244096:12345-0@lo:400: 00000100:00100000:0.0:1789023947.914263:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023947.914286:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422243968:12345-0@lo:400: 00000100:00100000:1.0:1789023947.914327:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422244096:12345-0@lo:400: Request processed in 74us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.914337:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023947.914345:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422243968:12345-0@lo:400: Request processed in 74us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.914353:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023947.914359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789023947.914369:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422244480:12345-0@lo:400: 00000100:00100000:0.0:1789023947.914375:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023947.914383:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422244352:12345-0@lo:400: 00000100:00100000:0.0:1789023947.914418:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422244352:12345-0@lo:400: Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.914424:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023947.914439:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422244480:12345-0@lo:400: Request processed in 70us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.914447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789023947.914498:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8e680 x1875927422244352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023947.914515:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422244352:0@lo:400: 00010000:00080000:0.0:1789023947.914527:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8f480 x1875927422243968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023947.914535:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422243968:0@lo:400: 00010000:00080000:0.0:1789023947.914544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8d180 x1875927422244480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023947.914551:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422244480:0@lo:400: 00000100:00100000:3.0:1789023947.914782:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422244224:12345-0@lo:400: Request processed in 32us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023947.914792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789023947.914824:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023947.914829:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789023947.914831:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023947.914992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023947.914999:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422243840:12345-0@lo:38: 00010000:00080000:2.0:1789023947.915030:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1789023947.915084:0:6517:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa736ef4b98cb352b 00000004:00100000:2.0:1789023947.915106:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789023947.915176:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cc3544a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023947.915241:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875927422243840:12345-0@lo:38: Request processed in 240us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.915249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789023947.915304:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bc80e00 x1875927422243840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023947.915315:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023947.915323:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789023947.915334:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789023947.915340:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789023947.915343:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789023947.915351:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422243840:0@lo:38: 00000100:00100000:3.0:1789023947.918991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422244224:0@lo:400: 00010000:00080000:3.0:1789023947.919038:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8ca80 x1875927422244736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023947.919051:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422244736:0@lo:400: 00010000:00080000:3.0:1789023947.919067:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8d880 x1875927422244096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023947.919075:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422244096:0@lo:400: 00010000:00080000:3.0:1789023947.919090:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8ea00 x1875927422244608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023947.919096:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422244608:0@lo:400: 00000020:01000004:0.0:1789023947.920360:0:9527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789023947.920386:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90cb0261b380) 00000020:00000080:0.0:1789023947.920428:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789023947.920546:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb021fb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789023947.920552:0:9527:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cb021fb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789023947.920555:0:9527:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb021fb800 3 00010000:00080000:0.0:1789023947.920597:0:9527:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3bf9f000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.118@tcp at head 00000100:00100000:3.0:1789023947.921515:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1875927422244864:0@lo:901: 00000100:00100000:3.0:1789023947.921629:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.921689:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023947.922836:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244864 00000100:00100000:2.0:1789023947.922854:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244864 00000100:00100000:2.0:1789023947.922965:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023947.922980:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875927422244864:12345-0@lo:901: 00000100:00100000:2.0:1789023947.923136:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9528:x1875927422244864:12345-0@lo:901: Request processed in 161us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.923176:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789023947.923842:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789023947.923924:0:9528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf8ea00 x1875927422244864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789023963 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023947.923956:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9528:1875927422244864:0@lo:901: 00010000:00010000:0.0:1789023947.924959:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789023947.925320:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789023947.925383:0:9527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789023947.925402:0:9527:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa736ef4b98cb3539 00000100:00080000:0.0:1789023947.925415:0:9527:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023947.925429:0:9527:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90cc3bf9f000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789023947.925476:0:9527:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bc81c00 x1875927422244992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023947.925511:0:9527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789023947.925794:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422244992:0@lo:38: 00000100:00100000:3.0:1789023947.926112:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023947.926556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422244992 00000100:00100000:0.0:1789023947.926570:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422244992 00000100:00100000:0.0:1789023947.926622:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023947.926633:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422244992:12345-0@lo:38: 00010000:00080000:0.0:1789023947.927935:0:6516:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1789023947.928001:0:6516:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa736ef4b98cb3540 00000004:00100000:0.0:1789023947.928022:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789023947.928188:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023947.928314:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875927422244992:12345-0@lo:38: Request processed in 1679us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023947.928325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789023947.928416:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bc81c00 x1875927422244992/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023947.928429:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789023947.928446:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789023947.928456:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789023947.928462:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789023947.928465:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789023947.928473:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422244992:0@lo:38: 00000040:00080000:0.0:1789023947.928645:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789023947.931589:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789023947.931648:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789023947.932006:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.932025:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789023947.932102:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789023947.932105:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789023947.932107:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023947.932108:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023947.932109:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023947.932111:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023947.932112:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023947.932114:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023947.932115:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023947.932117:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023947.932118:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023947.932123:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789023947.932126:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789023947.932127:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789023947.932129:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023947.932130:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023947.932135:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023947.932136:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023947.932136:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023947.932137:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023947.932138:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023947.932139:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023947.932140:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023947.933592:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789023947.933625:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422245120:0@lo:253: 00000100:00100000:3.0:1789023947.933746:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023947.933820:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023947.933872:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245120 00000100:00100000:3.0:1789023947.933883:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245120 00000100:00100000:3.0:1789023947.933950:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789023947.933961:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:9509:x1875927422245120:12345-0@lo:253: 20000000:01000000:3.0:1789023947.933996:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789023947.934017:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789023947.954265:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789023947.954303:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789023947.954324:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789023947.954354:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789023947.954387:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954407:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954415:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954423:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954471:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954485:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 17 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.954500:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422245248:0@lo:104: 00000100:00100000:1.0:1789023947.954602:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.954648:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245248 00000100:00100000:2.0:1789023947.954659:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245248 00010000:00010000:1.0:1789023947.954690:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.954701:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 17 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.954711:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422245376:0@lo:104: 00000100:00100000:2.0:1789023947.954720:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023947.954731:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422245248:12345-0@lo:104: 00000100:00100000:1.0:1789023947.954738:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023947.954744:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.954750:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789023947.954812:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023947.954818:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422245248:12345-0@lo:104: Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.954825:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023947.954839:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245376 00000100:00100000:2.0:1789023947.954842:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245376 00000100:00100000:2.0:1789023947.954858:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023947.954865:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422245376:12345-0@lo:104: 00010000:00010000:2.0:1789023947.954873:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.954879:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422245248:0@lo:104: 00000100:00100000:1.0:1789023947.954920:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875927422245376:0@lo:104: 00010000:00010000:2.0:1789023947.954926:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789023947.954934:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:6531:x1875927422245376:12345-0@lo:104: Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.954940:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789023947.954944:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.954968:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023947.954975:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.954996:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789023947.955000:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.955009:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023947.955015:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023947.955021:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023947.955101:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.955109:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.955122:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023947.955134:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.955191:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031a00 already unused, calling callback (ffffffffc146cc20) 00000100:00100000:1.0:1789023947.955199:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422245504:0@lo:103: 10000000:00010000:3.0:1789023947.955205:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.955206:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023947.955240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023947.955242:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023947.955252:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023947.955259:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789023947.955293:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245504 00000100:00100000:1.0:1789023947.955298:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245504 00010000:00010000:2.0:1789023947.955308:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb347c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3483 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.955316:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 18 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.955326:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023947.955329:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023947.955332:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023947.955344:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023947.955352:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+18:3643:x1875927422245504:12345-0@lo:103: 00010000:00010000:1.0:1789023947.955365:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023947.955370:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 18 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.955381:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 18 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.955393:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:9509:x1875927422245120:12345-0@lo:253: Request processed in 21432us (21645us total) trans 0 rc 0/0 00010000:00010000:1.0:1789023947.955396:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01488c00/0xa736ef4b98cb3483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb347c expref: 18 pid: 6510 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.955406:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1789023947.955411:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023947.955448:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+16:3643:x1875927422245504:12345-0@lo:103: Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023947.955454:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023947.955487:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422245504:0@lo:103: 00010000:00010000:3.0:1789023947.956048:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.956057:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023947.956085:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.956093:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00031a00/0xa736ef4b98cb3436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb343d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023947.956131:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.956135:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023947.956138:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023947.956238:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2a60d918-c836-4e5c-bd08-febd347ea726:9509:1875927422245120:0@lo:253: 10000000:01000000:3.0:1789023947.956256:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789023947.956260:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789023947.956262:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789023947.956264:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023947.956265:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023947.956266:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023947.956268:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023947.956280:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023947.956283:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023947.956284:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023947.956287:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023947.956289:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789023947.956306:0:9509:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789023947.956503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422245632:0@lo:103: 00000100:00100000:0.0:1789023947.956575:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023947.959465:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245632 00000100:00100000:2.0:1789023947.959481:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245632 00010000:00010000:2.0:1789023947.959571:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023947.959618:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023947.959628:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+16:3644:x1875927422245632:12345-0@lo:103: 00010000:00010000:2.0:1789023947.959643:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023947.959647:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959660:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959679:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489200/0xa736ef4b98cb343d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3436 expref: 16 pid: 6508 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959696:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959704:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023947.959722:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013681449s 00010000:00010000:2.0:1789023947.959728:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959735:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959741:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959747:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959759:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789023947.959764:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959773:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959787:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023947.959797:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023947.959893:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+15:3644:x1875927422245632:12345-0@lo:103: Request processed in 266us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023947.959901:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789023947.960956:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422245632:0@lo:103: 00010000:00010000:1.0:1789023947.962698:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.962718:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023947.962726:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3547 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789023947.975291:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789023947.975535:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789023947.975728:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789023947.975867:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789023947.976061:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789023947.976437:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789023947.984119:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789023948.004399:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789023948.004413:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789023948.004466:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789023948.004536:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789023948.004582:0:9509:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789023948.004635:0:9509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789023948.008634:0:9509:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023948.008954:0:9509:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789023948.621363:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023949.200604:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023949.200645:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422245760:0@lo:41: 00000100:00100000:0.0:1789023949.200756:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023949.201324:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245760 00000100:00100000:0.0:1789023949.201337:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245760 00000100:00100000:0.0:1789023949.201445:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023949.201458:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422245760:12345-0@lo:41: 00000004:00000024:0.0:1789023949.201508:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789023949.201582:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422245760:12345-0@lo:41: Request processed in 127us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023949.201589:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023949.208115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422245760:0@lo:41: 00000020:00000004:3.0:1789023949.239366:0:9583:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789023949.239636:0:9583:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789023949.647992:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023950.221378:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023950.221413:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422245888:0@lo:13: 00000100:00100000:1.0:1789023950.221503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023950.221615:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422245888 00000100:00100000:1.0:1789023950.221625:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422245888 00000100:00100000:1.0:1789023950.221762:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023950.221774:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422245888:12345-0@lo:13: 00002000:00000024:1.0:1789023950.221813:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023950.221863:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422245888:12345-0@lo:13: Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023950.221871:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789023950.222298:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf96300 x1875927422245888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023950.222321:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422245888:0@lo:13: 00000100:00080000:3.0:1789023950.224397:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023950.224424:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422246016:0@lo:13: 00000100:00100000:1.0:1789023950.224507:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023950.227225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246016 00000100:00100000:3.0:1789023950.227243:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246016 00000100:00100000:3.0:1789023950.227347:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023950.227360:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422246016:12345-0@lo:13: 00002000:00000024:3.0:1789023950.227395:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023950.227506:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422246016:12345-0@lo:13: Request processed in 149us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023950.227513:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789023950.227573:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ca80 x1875927422246016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023950.227598:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422246016:0@lo:13: 00000100:00080000:1.0:1789023950.227663:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789023950.671435:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023951.693029:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023952.268303:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422246144:0@lo:41: 00000100:00100000:0.0:1789023952.268381:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023952.268486:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246144 00000100:00100000:0.0:1789023952.268501:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246144 00000100:00100000:0.0:1789023952.268562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023952.268573:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422246144:12345-0@lo:41: 00000004:00000024:0.0:1789023952.268610:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789023952.268668:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422246144:12345-0@lo:41: Request processed in 97us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023952.268677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023952.268745:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422246144:0@lo:41: 00010000:00010000:1.0:1789023952.718512:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023953.293020:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422246272:0@lo:400: 00000100:00100000:1.0:1789023953.293099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293195:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422246784:0@lo:400: 00000100:00100000:1.0:1789023953.293232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293253:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422247296:0@lo:400: 00000100:00100000:1.0:1789023953.293275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293297:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789023953.293304:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422246400:0@lo:400: 00000100:00100000:1.0:1789023953.293328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293346:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422246912:0@lo:400: 00000100:00100000:1.0:1789023953.293367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293395:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422247424:0@lo:400: 00000100:00100000:1.0:1789023953.293422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422246528:0@lo:400: 00000100:00100000:1.0:1789023953.293477:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293496:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422247040:0@lo:400: 00000100:00100000:1.0:1789023953.293514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422247552:0@lo:400: 00000100:00100000:1.0:1789023953.293553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293563:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789023953.293568:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422246656:0@lo:400: 00000100:00100000:1.0:1789023953.293586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293596:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422247168:0@lo:400: 00000100:00100000:1.0:1789023953.293612:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023953.293719:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246784 00000100:00100000:1.0:1789023953.293728:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246784 00000100:00100000:1.0:1789023953.293771:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246528 00000100:00100000:1.0:1789023953.293775:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246528 00000100:00100000:1.0:1789023953.293792:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023953.293800:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422246784:12345-0@lo:400: 00000100:00100000:1.0:1789023953.293855:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422246784:12345-0@lo:400: Request processed in 55us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.293862:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023953.293879:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023953.293884:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422246528:12345-0@lo:400: 00000100:00100000:1.0:1789023953.293915:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422246528:12345-0@lo:400: Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.293921:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023953.293938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246400 00000100:00100000:1.0:1789023953.293941:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246400 00000100:00100000:1.0:1789023953.293957:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246912 00000100:00100000:1.0:1789023953.293960:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246912 00000100:00100000:1.0:1789023953.293980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247424 00000100:00100000:1.0:1789023953.293982:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247424 00000100:00100000:1.0:1789023953.293995:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247040 00000100:00100000:1.0:1789023953.294000:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247040 00000100:00100000:1.0:1789023953.294012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247552 00000100:00100000:1.0:1789023953.294014:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247552 00000100:00100000:1.0:1789023953.294022:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246656 00000100:00100000:1.0:1789023953.294024:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246656 00000100:00100000:1.0:1789023953.294035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789023953.294039:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422246400:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294068:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422246400:12345-0@lo:400: Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789023953.294095:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789023953.294100:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422246912:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294125:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422246912:12345-0@lo:400: Request processed in 25us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294131:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789023953.294140:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789023953.294163:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422247424:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294187:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422247424:12345-0@lo:400: Request processed in 42us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789023953.294203:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023953.294209:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422247040:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294244:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422247040:12345-0@lo:400: Request processed in 35us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294250:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023953.294260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023953.294265:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422247552:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294289:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422247552:12345-0@lo:400: Request processed in 24us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023953.294304:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789023953.294309:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422246656:12345-0@lo:400: 00000100:00100000:1.0:1789023953.294330:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422246656:12345-0@lo:400: Request processed in 21us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023953.294344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789023953.294372:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023953.294377:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023953.294403:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf94e00 x1875927422246656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294416:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422246656:0@lo:400: 00000100:00100000:1.0:1789023953.294427:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422246528:0@lo:400: 00010000:00080000:1.0:1789023953.294436:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf96d80 x1875927422247040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422247040:0@lo:400: 00010000:00080000:1.0:1789023953.294453:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fdc00 x1875927422247552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422247552:0@lo:400: 00010000:00080000:1.0:1789023953.294490:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97100 x1875927422246400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294498:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422246400:0@lo:400: 00010000:00080000:1.0:1789023953.294508:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf95180 x1875927422246912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422246912:0@lo:400: 00010000:00080000:1.0:1789023953.294526:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fc700 x1875927422247424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023953.294533:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422247424:0@lo:400: 00000100:00100000:1.0:1789023953.294555:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422246784:0@lo:400: 00000100:00100000:3.0:1789023953.294874:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247296 00000100:00100000:3.0:1789023953.294880:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247296 00000100:00100000:3.0:1789023953.294916:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247168 00000100:00100000:3.0:1789023953.294920:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247168 00000100:00100000:3.0:1789023953.294940:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789023953.294947:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422247296:12345-0@lo:400: 00000100:00100000:3.0:1789023953.295009:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422247296:12345-0@lo:400: Request processed in 62us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023953.295016:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789023953.295029:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789023953.295034:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422247168:12345-0@lo:400: 00000100:00100000:3.0:1789023953.295066:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422247168:12345-0@lo:400: Request processed in 32us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023953.295072:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789023953.295098:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789023953.295114:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf96a00 x1875927422247168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023953.295136:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422247168:0@lo:400: 00010000:00080000:3.0:1789023953.295174:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bed80 x1875927422247296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023953.295183:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422247296:0@lo:400: 00000100:00100000:2.0:1789023953.295766:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422246272 00000100:00100000:2.0:1789023953.295772:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422246272 00000100:00100000:2.0:1789023953.295812:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789023953.295820:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:3641:x1875927422246272:12345-0@lo:400: 00000100:00100000:2.0:1789023953.295869:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:3641:x1875927422246272:12345-0@lo:400: Request processed in 50us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023953.295876:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789023953.296272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422246272:0@lo:400: 00010000:00010000:3.0:1789023953.758348:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023954.320088:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422247680:0@lo:41: 00000100:00100000:1.0:1789023954.320192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023954.320849:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247680 00000100:00100000:0.0:1789023954.320858:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247680 00000100:00100000:0.0:1789023954.320912:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789023954.320921:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422247680:12345-0@lo:41: 00000004:00000024:0.0:1789023954.320954:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789023954.321004:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422247680:12345-0@lo:41: Request processed in 84us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023954.321010:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789023954.321646:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422247680:0@lo:41: 00000001:02000400:2.0:1789023954.450856:0:9873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789023954.764347:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789023955.184004:0:9925:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023955.184464:0:9925:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789023955.346401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422247808:0@lo:13: 00000100:00100000:0.0:1789023955.346477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.346686:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247808 00000100:00100000:0.0:1789023955.346695:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247808 00000100:00100000:0.0:1789023955.346753:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023955.346762:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422247808:12345-0@lo:13: 00002000:00000024:0.0:1789023955.346794:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023955.346839:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422247808:12345-0@lo:13: Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.346845:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789023955.346869:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023955.346908:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc82d80 x1875927422247808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.346927:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422247808:0@lo:13: 00000100:00100000:0.0:1789023955.347345:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422247936:0@lo:13: 00000100:00100000:0.0:1789023955.347440:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.347471:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422247936 00000100:00100000:0.0:1789023955.347476:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422247936 00000100:00100000:0.0:1789023955.347502:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789023955.347508:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422247936:12345-0@lo:13: 00002000:00000024:0.0:1789023955.347519:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023955.347547:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422247936:12345-0@lo:13: Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.348465:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789023955.348497:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023955.348524:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc82d80 x1875927422247936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.348541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422247936:0@lo:13: 00010000:00010000:3.0:1789023955.789376:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789023955.852561:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789023955.852569:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc3bd3a000 from 39 10000000:01000000:1.0:1789023955.852575:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023955.852625:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.852638:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.852649:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023955.852675:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248064:0@lo:101: 00000100:00100000:1.0:1789023955.852744:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.852801:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.853190:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248064 00000100:00100000:3.0:1789023955.853211:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248064 00000100:00100000:3.0:1789023955.853267:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789023955.853276:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422248064:12345-0@lo:101: 00010000:00010000:3.0:1789023955.853290:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.853304:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb354e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.853346:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.853356:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.853366:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4a00, rc 0) 00000100:00100000:3.0:1789023955.853410:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248064:12345-0@lo:101: Request processed in 134us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.853416:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789023955.853596:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248064:0@lo:101: 00010000:00010000:1.0:1789023955.853613:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.853623:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023955.853696:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248192:0@lo:501: 00000100:00100000:1.0:1789023955.853724:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.853749:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.854590:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248192 00000100:00100000:0.0:1789023955.854599:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248192 00000100:00100000:0.0:1789023955.854644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789023955.854654:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248192:12345-0@lo:501: 00000100:00100000:0.0:1789023955.854798:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248192:12345-0@lo:501: Request processed in 147us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.854806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789023955.854837:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248192:0@lo:501: 00000100:00100000:1.0:1789023955.855450:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248320:0@lo:503: 00000100:00100000:1.0:1789023955.855505:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.855570:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.855612:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248320 00000100:00100000:2.0:1789023955.855617:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248320 00000100:00100000:2.0:1789023955.855654:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789023955.855661:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248320:12345-0@lo:503: 00000100:00100000:2.0:1789023955.855791:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248320:12345-0@lo:503: Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.855803:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789023955.855910:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248320:0@lo:503: 00000100:00100000:2.0:1789023955.856553:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9977:1875927422248448:0@lo:502: 00000100:00100000:2.0:1789023955.856600:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.856678:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.856712:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248448 00000100:00100000:0.0:1789023955.856718:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248448 00000100:00100000:0.0:1789023955.856788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789023955.856797:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9977:x1875927422248448:12345-0@lo:502: 00000100:00100000:0.0:1789023955.856907:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:9977:x1875927422248448:12345-0@lo:502: Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.856913:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789023955.857005:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9977:1875927422248448:0@lo:502: 00000100:00100000:3.0:1789023955.857047:0:9977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9977:1875927422248576:0@lo:502: 00000100:00100000:3.0:1789023955.857081:0:9977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.857631:0:9977:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04c350c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.857696:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248576 00000100:00100000:2.0:1789023955.857702:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248576 00000100:00100000:2.0:1789023955.857731:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789023955.857738:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:9977:x1875927422248576:12345-0@lo:502: 00000100:00100000:2.0:1789023955.857827:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:9977:x1875927422248576:12345-0@lo:502: Request processed in 89us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.857834:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789023955.857906:0:9977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9977:1875927422248576:0@lo:502: 00000040:00080000:3.0:1789023955.857928:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789023955.858206:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789023955.858231:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023955.858241:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.858252:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023955.858262:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789023955.858265:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789023955.858268:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023955.858293:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.858301:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.858321:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.858335:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248704:0@lo:101: 00000100:00100000:2.0:1789023955.858364:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.858383:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.858521:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248704 00000100:00100000:3.0:1789023955.858526:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248704 00000100:00100000:3.0:1789023955.858546:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789023955.858553:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422248704:12345-0@lo:101: 00010000:00010000:3.0:1789023955.858562:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.858574:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb355c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.858593:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.858616:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.858624:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5400, rc 0) 00000100:00100000:3.0:1789023955.858657:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422248704:12345-0@lo:101: Request processed in 105us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.858663:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789023955.858692:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248704:0@lo:101: 00010000:00010000:3.0:1789023955.858703:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.858712:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.858761:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248832:0@lo:501: 00000100:00100000:3.0:1789023955.858784:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.858798:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04c35300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.858809:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248832 00000100:00100000:3.0:1789023955.858812:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248832 00000100:00100000:3.0:1789023955.858827:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789023955.858833:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422248832:12345-0@lo:501: 00000100:00100000:3.0:1789023955.858929:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422248832:12345-0@lo:501: Request processed in 96us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.859081:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789023955.859114:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248832:0@lo:501: 00000100:00100000:3.0:1789023955.859139:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248960:0@lo:503: 00000100:00100000:3.0:1789023955.859517:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.859587:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04c35300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.859671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422248960 00000100:00100000:0.0:1789023955.859676:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422248960 00000100:00100000:2.0:1789023955.859713:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789023955.859722:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422248960:12345-0@lo:503: 00000100:00100000:2.0:1789023955.859815:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422248960:12345-0@lo:503: Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.859822:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789023955.859899:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422248960:0@lo:503: 00000100:00100000:2.0:1789023955.860597:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9978:1875927422249088:0@lo:502: 00000100:00100000:2.0:1789023955.860635:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.860694:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.860759:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249088 00000100:00100000:0.0:1789023955.860765:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249088 00000100:00100000:0.0:1789023955.860786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789023955.860793:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9978:x1875927422249088:12345-0@lo:502: 00000100:00100000:0.0:1789023955.860883:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9978:x1875927422249088:12345-0@lo:502: Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.860890:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789023955.861078:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9978:1875927422249088:0@lo:502: 00000020:01000000:2.0:1789023955.861098:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023955.861106:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023955.861109:0:9978:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789023955.861126:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789023955.861128:0:9978:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789023955.861142:0:9978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9978:1875927422249216:0@lo:502: 00000100:00100000:2.0:1789023955.861187:0:9978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.861215:0:9978:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.861457:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249216 00000100:00100000:0.0:1789023955.861462:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249216 00000100:00100000:0.0:1789023955.861481:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789023955.861487:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9978:x1875927422249216:12345-0@lo:502: 00000100:00100000:0.0:1789023955.861561:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:9978:x1875927422249216:12345-0@lo:502: Request processed in 73us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.861568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789023955.861692:0:9978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9978:1875927422249216:0@lo:502: 00000020:01000000:2.0:1789023955.861708:0:9978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023955.861718:0:9978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023955.861720:0:9978:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789023955.861724:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789023955.861869:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789023955.861891:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789023955.861900:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.861910:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023955.862084:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789023955.862088:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc414b7800 from 39 10000000:01000000:0.0:1789023955.862091:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023955.862116:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.862123:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.862131:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023955.862186:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249344:0@lo:101: 00000100:00100000:0.0:1789023955.862290:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.862313:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.862370:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249344 00000100:00100000:1.0:1789023955.862375:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249344 00000100:00100000:1.0:1789023955.862411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789023955.862419:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422249344:12345-0@lo:101: 00010000:00010000:1.0:1789023955.862428:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023955.862438:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb356a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.862459:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.862470:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.862478:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160400, rc 0) 00000100:00100000:1.0:1789023955.862516:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249344:12345-0@lo:101: Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.862521:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789023955.862624:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249344:0@lo:101: 00010000:00010000:2.0:1789023955.862636:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.862645:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.862691:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249472:0@lo:501: 00000100:00100000:2.0:1789023955.862715:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.862731:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.862787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249472 00000100:00100000:1.0:1789023955.862791:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249472 00000100:00100000:1.0:1789023955.862808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789023955.862814:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249472:12345-0@lo:501: 00000100:00100000:1.0:1789023955.862923:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249472:12345-0@lo:501: Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.863116:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789023955.863325:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249472:0@lo:501: 00000100:00100000:2.0:1789023955.863349:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249600:0@lo:503: 00000100:00100000:2.0:1789023955.863389:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.863415:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.863484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249600 00000100:00100000:1.0:1789023955.863489:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249600 00000100:00100000:1.0:1789023955.863516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789023955.863522:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249600:12345-0@lo:503: 00000100:00100000:1.0:1789023955.863607:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249600:12345-0@lo:503: Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.863614:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789023955.863712:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249600:0@lo:503: 00000100:00100000:1.0:1789023955.864111:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9979:1875927422249728:0@lo:502: 00000100:00100000:1.0:1789023955.864228:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.864251:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249728 00000100:00100000:1.0:1789023955.864254:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249728 00000100:00100000:1.0:1789023955.864277:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789023955.864284:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:9979:x1875927422249728:12345-0@lo:502: 00000100:00100000:1.0:1789023955.864357:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:9979:x1875927422249728:12345-0@lo:502: Request processed in 73us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.864364:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789023955.864398:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08a99480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.864411:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9979:1875927422249728:0@lo:502: 00000100:00100000:1.0:1789023955.864450:0:9979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9979:1875927422249856:0@lo:502: 00000100:00100000:1.0:1789023955.864487:0:9979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.864504:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249856 00000100:00100000:1.0:1789023955.864508:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249856 00000100:00100000:1.0:1789023955.864528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789023955.864533:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:9979:x1875927422249856:12345-0@lo:502: 00000100:00100000:1.0:1789023955.864605:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:9979:x1875927422249856:12345-0@lo:502: Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.864612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789023955.864638:0:9979:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.864649:0:9979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9979:1875927422249856:0@lo:502: 00000040:00080000:1.0:1789023955.864665:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789023955.865173:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789023955.865204:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023955.865214:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.865224:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023955.865233:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789023955.865235:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc414b7800 from 6 10000000:01000000:2.0:1789023955.865245:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789023955.865268:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.865275:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.865283:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.865294:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249984:0@lo:101: 00000100:00100000:2.0:1789023955.865322:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.865342:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.865450:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422249984 00000100:00100000:3.0:1789023955.865456:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422249984 00000100:00100000:3.0:1789023955.865491:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789023955.865498:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422249984:12345-0@lo:101: 00010000:00010000:3.0:1789023955.865507:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.865519:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5c00/0xa736ef4b98cb357f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3578 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.865538:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5c00/0xa736ef4b98cb357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3578 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.865549:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5c00/0xa736ef4b98cb357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3578 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.865558:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5c00, rc 0) 00000100:00100000:3.0:1789023955.865595:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422249984:12345-0@lo:101: Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.865600:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789023955.865631:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422249984:0@lo:101: 00010000:00010000:3.0:1789023955.865642:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.865650:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.865702:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250112:0@lo:256: 00000100:00100000:3.0:1789023955.865731:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.865751:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04c35300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.865762:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250112 00000100:00100000:3.0:1789023955.865765:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250112 00000100:00100000:3.0:1789023955.865780:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789023955.865785:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422250112:12345-0@lo:256: 20000000:01000000:3.0:1789023955.865796:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023955.865812:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023955.865815:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789023955.865880:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422250112:12345-0@lo:256: Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.865886:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789023955.865913:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250112:0@lo:256: 10000000:01000000:3.0:1789023955.866050:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789023955.866057:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866064:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023955.866071:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789023955.866072:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789023955.866074:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789023955.866088:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866105:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866113:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.866125:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250240:0@lo:101: 00000100:00100000:3.0:1789023955.866171:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.866191:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.866267:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250240 00000100:00100000:3.0:1789023955.866271:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250240 00000100:00100000:3.0:1789023955.866288:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789023955.866293:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422250240:12345-0@lo:101: 00010000:00010000:3.0:1789023955.866300:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.866307:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3586 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866321:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866330:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866337:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4e00, rc 0) 00000100:00100000:3.0:1789023955.866364:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422250240:12345-0@lo:101: Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.866370:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789023955.866395:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250240:0@lo:101: 00010000:00010000:3.0:1789023955.866410:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.866418:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.866461:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250368:0@lo:501: 00000100:00100000:3.0:1789023955.866484:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.866497:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.866508:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250368 00000100:00100000:3.0:1789023955.866511:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250368 00000100:00100000:3.0:1789023955.866526:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789023955.866531:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422250368:12345-0@lo:501: 00000100:00100000:3.0:1789023955.866621:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422250368:12345-0@lo:501: Request processed in 89us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.866628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789023955.866652:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250368:0@lo:501: 00000100:00100000:3.0:1789023955.866684:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250496:0@lo:503: 00000100:00100000:3.0:1789023955.866717:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.866731:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.866742:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250496 00000100:00100000:3.0:1789023955.866745:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250496 00000100:00100000:3.0:1789023955.866760:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789023955.866765:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422250496:12345-0@lo:503: 00000100:00100000:3.0:1789023955.866836:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422250496:12345-0@lo:503: Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.866842:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789023955.866882:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422250496:0@lo:503: 00000100:00100000:2.0:1789023955.867601:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9980:1875927422250624:0@lo:502: 00000100:00100000:2.0:1789023955.867640:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.867699:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596900 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.867730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250624 00000100:00100000:3.0:1789023955.867734:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250624 00000100:00100000:3.0:1789023955.867792:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789023955.867800:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:9980:x1875927422250624:12345-0@lo:502: 00000100:00100000:3.0:1789023955.867890:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:9980:x1875927422250624:12345-0@lo:502: Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.867896:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789023955.867972:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9980:1875927422250624:0@lo:502: 00000020:01000000:0.0:1789023955.867995:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023955.868002:0:9980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789023955.868008:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023955.868010:0:9980:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789023955.868015:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789023955.868019:0:9980:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789023955.868041:0:9980:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789023955.868043:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023955.868060:0:9980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90cb02618000) 00000020:00000080:0.0:1789023955.868083:0:9980:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789023955.868090:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789023955.868219:0:9980:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789023955.868232:0:9980:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789023955.868245:0:9980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb359b 00010000:00080000:0.0:1789023955.868275:0:9980:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb033f7800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789023955.868515:0:9980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789023955.868635:0:9980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789023955.868646:0:9980:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789023955.868872:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023955.868991:0:9980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023955.869121:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789023955.869244:0:9980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789023955.870055:0:9981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789023955.870060:0:9981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789023955.870882:0:9980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789023955.870894:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789023955.870934:0:9980:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789023955.870963:0:9980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb35a2 00000100:00080000:0.0:1789023955.870973:0:9980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023955.870984:0:9980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cb033f7800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789023955.871018:0:9980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bc82d80 x1875927422250752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023955.871075:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422250752:0@lo:8: 00000100:00100000:3.0:1789023955.871136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789023955.871355:0:9980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789023955.871418:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023955.871423:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023955.871425:0:9980:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789023955.871429:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023955.871432:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023955.871434:0:9980:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789023955.871437:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789023955.871439:0:9980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789023955.871461:0:9980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9980:1875927422250880:0@lo:502: 00000100:00100000:0.0:1789023955.871506:0:9980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.871522:0:9980:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.871614:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250752 00000100:00100000:1.0:1789023955.871623:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250752 00000100:00100000:1.0:1789023955.871654:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023955.871662:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875927422250752:12345-0@lo:8: 00010000:00080000:1.0:1789023955.871686:0:8432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1789023955.871714:0:8432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb35a9 00002000:00100000:1.0:1789023955.871726:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90cb0259c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789023955.871731:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789023955.871735:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789023955.871789:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789023955.872003:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789023955.872025:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90cb0259e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023955.872256:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422251264:0@lo:400: 00000100:00100000:2.0:1789023955.872288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.872308:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422251776:0@lo:400: 00000100:00100000:2.0:1789023955.872328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.872346:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789023955.872351:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422251392:0@lo:400: 00000100:00100000:2.0:1789023955.872375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.872391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422251904:0@lo:400: 00000100:00100000:2.0:1789023955.872414:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.872547:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422251008:0@lo:400: 00000100:00100000:0.0:1789023955.872575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.872602:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422251520:0@lo:400: 00000100:00100000:0.0:1789023955.872622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.872634:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789023955.872640:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422251136:0@lo:400: 00000100:00100000:0.0:1789023955.872659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.872675:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422251648:0@lo:400: 00000100:00100000:0.0:1789023955.872693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.872713:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251392 00000100:00100000:0.0:1789023955.872717:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251392 00000100:00100000:0.0:1789023955.872748:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251136 00000100:00100000:0.0:1789023955.872750:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251136 00000100:00100000:0.0:1789023955.872765:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789023955.872771:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422251392:12345-0@lo:400: 00000100:00100000:0.0:1789023955.872806:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422251392:12345-0@lo:400: Request processed in 35us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.872812:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789023955.872826:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789023955.872830:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422251136:12345-0@lo:400: 00000100:00100000:0.0:1789023955.872856:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422251136:12345-0@lo:400: Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.872861:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789023955.872889:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422251136:0@lo:400: 00000100:00100000:2.0:1789023955.872946:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251264 00000100:00100000:2.0:1789023955.872951:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251264 00000100:00100000:2.0:1789023955.872972:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251776 00000100:00100000:2.0:1789023955.872982:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251776 00000100:00100000:2.0:1789023955.873012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251904 00000100:00100000:2.0:1789023955.873014:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251904 00000100:00100000:2.0:1789023955.873027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251008 00000100:00100000:2.0:1789023955.873029:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251008 00000100:00100000:2.0:1789023955.873037:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251520 00000100:00100000:2.0:1789023955.873039:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251520 00000100:00100000:2.0:1789023955.873048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422251648 00000100:00100000:2.0:1789023955.873050:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422251648 00000100:00100000:2.0:1789023955.873061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789023955.873066:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422251264:12345-0@lo:400: 00000100:00100000:2.0:1789023955.873093:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422251264:12345-0@lo:400: Request processed in 27us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789023955.873107:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023955.873112:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422251776:12345-0@lo:400: 00000100:00100000:2.0:1789023955.873134:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422251776:12345-0@lo:400: Request processed in 22us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023955.873169:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789023955.873175:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422251904:12345-0@lo:400: 00000100:00080000:0.0:1789023955.873285:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789023955.873290:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023955.873327:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422251904:12345-0@lo:400: Request processed in 151us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873333:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789023955.873345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023955.873352:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422251008:12345-0@lo:400: 00000100:00100000:2.0:1789023955.873391:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422251008:12345-0@lo:400: Request processed in 39us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023955.873421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789023955.873427:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422251520:12345-0@lo:400: 00000100:00100000:2.0:1789023955.873456:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422251520:12345-0@lo:400: Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789023955.873472:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789023955.873477:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422251648:12345-0@lo:400: 00000100:00100000:2.0:1789023955.873501:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422251648:12345-0@lo:400: Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.873506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789023955.873538:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422251392:0@lo:400: 00010000:00080000:2.0:1789023955.873553:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0380 x1875927422251904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.873563:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422251904:0@lo:400: 00010000:00080000:2.0:1789023955.873573:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a1c00 x1875927422251264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.873582:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422251264:0@lo:400: 00010000:00080000:2.0:1789023955.873591:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a3800 x1875927422251776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.873599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422251776:0@lo:400: 00010000:00080000:0.0:1789023955.873675:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a2300 x1875927422251648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.873691:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422251648:0@lo:400: 00010000:00080000:0.0:1789023955.873703:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0a80 x1875927422251008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.873710:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422251008:0@lo:400: 00010000:00080000:0.0:1789023955.873719:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a3480 x1875927422251520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.873727:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422251520:0@lo:400: 00000100:00100000:0.0:1789023955.873856:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422250880 00000100:00100000:0.0:1789023955.873861:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422250880 00000100:00100000:0.0:1789023955.873895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789023955.873902:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:9980:x1875927422250880:12345-0@lo:502: 00000100:00100000:0.0:1789023955.874031:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:9980:x1875927422250880:12345-0@lo:502: Request processed in 130us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.874037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789023955.874084:0:9980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9980:1875927422250880:0@lo:502: 00000020:01000000:0.0:1789023955.874115:0:9980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023955.874122:0:9980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023955.874124:0:9980:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789023955.874128:0:9980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1789023955.874504:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422250752:12345-0@lo:8: Request processed in 2840us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.874520:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789023955.874584:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc82d80 x1875927422250752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023955.874594:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789023955.874602:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789023955.874610:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789023955.874615:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789023955.874619:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb033f7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789023955.874660:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789023955.874667:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422250752:0@lo:8: 00000020:01000000:3.0:1789023955.874688:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789023955.874728:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789023955.874738:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.874749:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023955.874769:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789023955.874772:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc199e6000 from 39 10000000:01000000:3.0:1789023955.874774:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789023955.874800:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.874808:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.874817:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.874833:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252032:0@lo:101: 00000100:00100000:3.0:1789023955.874866:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.874937:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.874968:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422252160:0@lo:700: 00000100:00100000:3.0:1789023955.875050:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.875072:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdf00 going to sleep for 11 seconds 00000004:00080000:1.0:1789023955.875105:0:9981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789023955.875217:0:9981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 273911069964ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789023955.875224:0:9981:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789023955.875636:0:8894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252160 00000100:00100000:2.0:1789023955.875644:0:8894:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252160 00000100:00100000:2.0:1789023955.875703:0:8894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023955.875713:0:8894:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9982:x1875927422252160:12345-0@lo:700: 00000100:00100000:2.0:1789023955.875749:0:8894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8894:1875927422252288:0@lo:700: 00000100:00100000:2.0:1789023955.875784:0:8894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.875805:0:8894:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.875822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252288 00000100:00100000:2.0:1789023955.875826:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252288 00000100:00100000:2.0:1789023955.875848:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023955.875854:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8894:x1875927422252288:12345-0@lo:700: 00000100:00080000:3.0:1789023955.875969:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023955.876074:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252032 00000100:00100000:0.0:1789023955.876079:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252032 00000100:00100000:0.0:1789023955.876166:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789023955.876175:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422252032:12345-0@lo:101: 00010000:00010000:0.0:1789023955.876183:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023955.876281:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb35b0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.876306:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.876317:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023955.876326:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489800, rc 0) 00000100:00100000:0.0:1789023955.876374:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252032:12345-0@lo:101: Request processed in 201us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.876380:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789023955.876466:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252032:0@lo:101: 00010000:00010000:3.0:1789023955.876480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.876489:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023955.876545:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252416:0@lo:501: 00000100:00100000:3.0:1789023955.876577:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.876789:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.876849:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252416 00000100:00100000:1.0:1789023955.876853:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252416 00000100:00100000:2.0:1789023955.876886:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789023955.876894:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252416:12345-0@lo:501: 00000100:00100000:2.0:1789023955.876998:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252416:12345-0@lo:501: Request processed in 106us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.877004:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789023955.877063:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252416:0@lo:501: 00000100:00100000:3.0:1789023955.877086:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252544:0@lo:503: 00000100:00100000:3.0:1789023955.877119:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.877138:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.877221:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252544 00000100:00100000:2.0:1789023955.877225:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252544 00000100:00100000:2.0:1789023955.877241:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789023955.877247:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252544:12345-0@lo:503: 00000100:00100000:2.0:1789023955.877315:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252544:12345-0@lo:503: Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.877322:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789023955.877470:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252544:0@lo:503: 00000100:00100000:3.0:1789023955.877844:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9983:1875927422252672:0@lo:502: 00000100:00100000:3.0:1789023955.877902:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.877924:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efd000 going to sleep for 11 seconds 00000004:00080000:2.0:1789023955.878018:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789023955.878051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252672 00000100:00100000:2.0:1789023955.878054:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252672 00000100:00100000:2.0:1789023955.878071:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789023955.878076:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:9983:x1875927422252672:12345-0@lo:502: 00000100:00100000:2.0:1789023955.878142:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:9983:x1875927422252672:12345-0@lo:502: Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.878180:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789023955.878317:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9983:1875927422252672:0@lo:502: 00000100:00100000:3.0:1789023955.878353:0:9983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9983:1875927422252800:0@lo:502: 00000100:00100000:3.0:1789023955.878380:0:9983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023955.878393:0:9983:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19efd000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.878426:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252800 00000100:00100000:2.0:1789023955.878429:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252800 00000100:00100000:2.0:1789023955.878443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789023955.878448:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:9983:x1875927422252800:12345-0@lo:502: 00000100:00100000:2.0:1789023955.878505:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:9983:x1875927422252800:12345-0@lo:502: Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.878511:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789023955.878567:0:9983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9983:1875927422252800:0@lo:502: 00000040:00080000:3.0:1789023955.878584:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789023955.878728:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789023955.878752:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023955.878760:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.878770:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023955.878779:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789023955.878781:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cc199e6000 from 6 10000000:01000000:2.0:1789023955.878784:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789023955.878805:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.878813:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.878821:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.878832:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252928:0@lo:101: 00000100:00100000:2.0:1789023955.878864:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.878884:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.878924:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422252928 00000100:00100000:3.0:1789023955.878928:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422252928 00000100:00100000:3.0:1789023955.878947:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789023955.878953:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422252928:12345-0@lo:101: 00010000:00010000:3.0:1789023955.878961:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.878972:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb35c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb35be expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.878990:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb35be expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.879007:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35be expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.879016:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4400, rc 0) 00000100:00100000:3.0:1789023955.879054:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422252928:12345-0@lo:101: Request processed in 101us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.879060:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789023955.879190:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422252928:0@lo:101: 00010000:00010000:2.0:1789023955.879359:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.879368:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.879405:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253056:0@lo:256: 00000100:00100000:2.0:1789023955.879435:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.879462:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.879500:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253056 00000100:00100000:3.0:1789023955.879505:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253056 00000100:00100000:3.0:1789023955.879534:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789023955.879540:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422253056:12345-0@lo:256: 20000000:01000000:3.0:1789023955.879553:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023955.879570:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023955.879573:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789023955.879651:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422253056:12345-0@lo:256: Request processed in 111us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.879657:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789023955.879739:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253056:0@lo:256: 10000000:01000000:2.0:1789023955.879780:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789023955.879786:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.879795:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023955.879802:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789023955.879804:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789023955.879807:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023955.879821:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.879827:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.879844:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.879855:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253184:0@lo:101: 00000100:00100000:2.0:1789023955.879880:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.879898:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.879934:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253184 00000100:00100000:3.0:1789023955.879938:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253184 00000100:00100000:3.0:1789023955.879964:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789023955.879970:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422253184:12345-0@lo:101: 00010000:00010000:3.0:1789023955.879977:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.879986:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb35cc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.880000:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.880020:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.880027:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4600, rc 0) 00000100:00100000:3.0:1789023955.880098:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253184:12345-0@lo:101: Request processed in 128us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.880104:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789023955.880388:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253184:0@lo:101: 00010000:00010000:2.0:1789023955.880400:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.880408:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.880455:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253312:0@lo:501: 00000100:00100000:2.0:1789023955.880480:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.880542:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023955.880571:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253312 00000100:00100000:0.0:1789023955.880575:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253312 00000100:00100000:0.0:1789023955.880645:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789023955.880654:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253312:12345-0@lo:501: 00000100:00100000:0.0:1789023955.880768:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253312:12345-0@lo:501: Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.880775:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789023955.880827:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253312:0@lo:501: 00000100:00100000:2.0:1789023955.880854:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253440:0@lo:503: 00000100:00100000:2.0:1789023955.880893:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.880950:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023955.881003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253440 00000100:00100000:1.0:1789023955.881008:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253440 00000100:00100000:1.0:1789023955.881030:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789023955.881037:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253440:12345-0@lo:503: 00000100:00100000:1.0:1789023955.881125:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253440:12345-0@lo:503: Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.881132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789023955.881265:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253440:0@lo:503: 00000100:00100000:1.0:1789023955.881611:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9984:1875927422253568:0@lo:502: 00000100:00100000:1.0:1789023955.881645:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.881674:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.881721:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253568 00000100:00100000:2.0:1789023955.881725:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253568 00000100:00100000:2.0:1789023955.881744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789023955.881751:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:9984:x1875927422253568:12345-0@lo:502: 00000100:00100000:2.0:1789023955.881844:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:9984:x1875927422253568:12345-0@lo:502: Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.881851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789023955.881919:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9984:1875927422253568:0@lo:502: 00000020:01000000:1.0:1789023955.881941:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789023955.881948:0:9984:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789023955.881956:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023955.881958:0:9984:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789023955.881966:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789023955.881969:0:9984:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:1.0:1789023955.881991:0:9984:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789023955.881994:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789023955.882008:0:9984:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90cc344eb380) 00000020:00000080:1.0:1789023955.882033:0:9984:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1789023955.882039:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789023955.882122:0:9984:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789023955.882128:0:9984:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789023955.882136:0:9984:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb35e1 00010000:00080000:1.0:1789023955.882281:0:9984:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb01a01800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789023955.882538:0:9984:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1789023955.882665:0:9984:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789023955.882676:0:9984:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789023955.882847:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023955.882976:0:9984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023955.883115:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789023955.883454:0:9984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789023955.883814:0:9985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023955.883819:0:9985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789023955.884613:0:9984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789023955.884625:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789023955.884663:0:9984:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789023955.884691:0:9984:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb35e8 00000100:00080000:1.0:1789023955.884701:0:9984:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789023955.884711:0:9984:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cb01a01800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789023955.884750:0:9984:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3be9f800 x1875927422253696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023955.884820:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422253696:0@lo:8: 00000100:00100000:3.0:1789023955.884888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789023955.884945:0:9984:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789023955.885003:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023955.885007:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023955.885010:0:9984:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789023955.885014:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023955.885018:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023955.885019:0:9984:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789023955.885023:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789023955.885025:0:9984:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789023955.885048:0:9984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9984:1875927422253824:0@lo:502: 00000100:00100000:1.0:1789023955.885095:0:9984:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.885137:0:9984:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789023955.885315:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253824 00000100:00100000:2.0:1789023955.885323:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253824 00000100:00100000:2.0:1789023955.885363:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789023955.885372:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:9984:x1875927422253824:12345-0@lo:502: 00000100:00100000:2.0:1789023955.885490:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:9984:x1875927422253824:12345-0@lo:502: Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.885498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789023955.886496:0:9984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:9984:1875927422253824:0@lo:502: 00000020:01000000:1.0:1789023955.886530:0:9984:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023955.886538:0:9984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023955.886540:0:9984:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789023955.886552:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789023955.886942:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789023955.886966:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789023955.886976:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.886989:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023955.887002:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789023955.887005:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cc339999c0 from 1 10000000:01000000:2.0:1789023955.887009:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789023955.887040:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.887049:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023955.887058:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023955.887087:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253952:0@lo:101: 00000100:00100000:2.0:1789023955.887134:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.887190:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.887248:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253952 00000100:00100000:3.0:1789023955.887256:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253952 00000100:00100000:3.0:1789023955.887296:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789023955.887305:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422253952:12345-0@lo:101: 00010000:00010000:3.0:1789023955.887316:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023955.887329:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb35ef expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.887350:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.887360:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023955.887368:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031a00, rc 0) 00000100:00100000:3.0:1789023955.887410:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422253952:12345-0@lo:101: Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.887421:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789023955.887752:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422253952:0@lo:101: 00010000:00010000:1.0:1789023955.887765:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.887774:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023955.887833:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422254080:0@lo:501: 00000100:00100000:1.0:1789023955.887861:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.887885:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.887986:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254080 00000100:00100000:3.0:1789023955.887991:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254080 00000100:00100000:3.0:1789023955.888022:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789023955.888030:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422254080:12345-0@lo:501: 00000100:00100000:3.0:1789023955.888099:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422254080:12345-0@lo:501: Request processed in 70us (237us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023955.888105:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789023955.888468:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422254080:0@lo:501: 10000000:01000000:1.0:1789023955.888495:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789023955.888501:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023955.888510:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023955.889897:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422253696 00000100:00100000:0.0:1789023955.889908:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422253696 00000100:00100000:0.0:1789023955.889988:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789023955.889996:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875927422253696:12345-0@lo:8: 00010000:00080000:0.0:1789023955.890031:0:8904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1789023955.890067:0:8904:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb35fd 00002000:00100000:0.0:1789023955.890080:0:8904:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90cb033f5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789023955.890084:0:8904:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789023955.890099:0:8904:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789023955.890189:0:8904:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789023955.890232:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cb033f2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023955.890306:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422253696:12345-0@lo:8: Request processed in 308us (5418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.890313:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789023955.890530:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3be9f800 x1875927422253696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.890544:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789023955.890552:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789023955.890560:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789023955.890565:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789023955.890568:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb01a01800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789023955.890621:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789023955.890628:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422253696:0@lo:8: 00000004:00080000:3.0:1789023955.890678:0:9985:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789023955.890745:0:9985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273926598323ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789023955.890751:0:9985:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 40000000:02000000:0.0:1789023955.891039:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:3.0:1789023955.902323:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789023955.903107:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023955.903129:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422254208:0@lo:13: 00000100:00100000:1.0:1789023955.903235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.903276:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254208 00000100:00100000:1.0:1789023955.903295:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254208 00000100:00100000:1.0:1789023955.903345:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023955.903352:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422254208:12345-0@lo:13: 00002000:00000024:1.0:1789023955.903379:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789023955.903420:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422254208:12345-0@lo:13: Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.903427:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789023955.903448:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789023955.903475:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fc700 x1875927422254208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023955.903494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422254208:0@lo:13: 00000004:00080000:1.0:1789023955.903514:0:9986:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789023955.903532:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254336:0@lo:7: 00000100:00100000:1.0:1789023955.903555:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.903578:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254336 00000100:00100000:1.0:1789023955.903582:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254336 00000100:00100000:1.0:1789023955.903607:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023955.903614:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9986:x1875927422254336:12345-0@lo:7: 00000100:00100000:0.0:1789023955.909697:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8894:x1875927422252288:12345-0@lo:700: Request processed in 33833us (33902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023955.909714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789023955.909953:0:8894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021d3480 x1875927422252288/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.909969:0:8894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8894:1875927422252288:0@lo:700: 40000000:02000000:2.0:1789023955.909982:0:8894:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1789023955.913292:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00002000:00080000:1.0:1789023955.918564:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789023955.918573:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789023955.918710:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9986:x1875927422254336:12345-0@lo:7: Request processed in 15090us (15148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.918721:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789023955.920788:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fc700 x1875927422254336/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00100000:1.0:1789023955.921972:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789023955.921983:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789023955.922140:0:8894:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422252160:12345-0@lo:700: Request processed in 46425us (47085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.922176:0:8894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789023955.922282:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8e300 x1875927422252160/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023955.922297:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422252160:0@lo:700: 00000100:00100000:0.0:1789023955.922514:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254336:0@lo:7: 00000004:00080000:0.0:1789023955.922526:0:9986:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789023955.924672:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254464:0@lo:5: 00000100:00100000:1.0:1789023955.924741:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.924911:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.925257:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254464 00000100:00100000:3.0:1789023955.925265:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254464 00000004:00080000:1.0:1789023955.933088:0:9982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789023955.933122:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422254720:0@lo:7: 00000100:00100000:1.0:1789023955.933224:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.933268:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422254592:0@lo:13: 00000100:00100000:2.0:1789023955.933304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.933371:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254592 00000100:00100000:2.0:1789023955.933378:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254592 00000100:00100000:2.0:1789023955.933423:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789023955.933431:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422254592:12345-0@lo:13: 00002000:00000024:2.0:1789023955.933453:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789023955.933518:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422254592:12345-0@lo:13: Request processed in 87us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023955.933525:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789023955.933582:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf95180 x1875927422254592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.933602:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422254592:0@lo:13: 00000100:00100000:1.0:1789023955.935170:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.938899:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254720 00000100:00100000:3.0:1789023955.938917:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254720 00000100:00100000:3.0:1789023955.939015:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789023955.939026:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9986:x1875927422254464:12345-0@lo:5: 00002000:00080000:3.0:1789023955.939062:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789023955.939066:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789023955.939524:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9986:x1875927422254464:12345-0@lo:5: Request processed in 499us (14781us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789023955.939531:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023955.939673:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023955.939685:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422254720:12345-0@lo:7: 00002000:00080000:1.0:1789023955.942936:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789023955.942946:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789023955.943044:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422254720:12345-0@lo:7: Request processed in 3357us (9814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023955.943055:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789023955.943114:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97100 x1875927422254720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023955.943129:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422254720:0@lo:7: 00000004:00080000:1.0:1789023955.943143:0:9982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1789023955.944493:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf96a00 x1875927422254464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.944523:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254464:0@lo:5: 00000004:00080000:2.0:1789023955.944537:0:9986:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789023955.944651:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254848:0@lo:700: 00000100:00100000:2.0:1789023955.944700:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023955.944736:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.944803:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254848 00000100:00100000:3.0:1789023955.944819:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254848 00000100:00100000:3.0:1789023955.944871:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023955.944880:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9986:x1875927422254848:12345-0@lo:700: 00000100:00100000:1.0:1789023955.946744:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422254976:0@lo:5: 00000100:00100000:1.0:1789023955.946804:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.946848:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.946915:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422254976 00000100:00100000:3.0:1789023955.946923:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422254976 00000100:00100000:3.0:1789023955.946995:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023955.947004:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422254976:12345-0@lo:5: 00002000:00080000:3.0:1789023955.947033:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789023955.947090:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422254976:12345-0@lo:5: Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.947096:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789023955.947247:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97100 x1875927422254976/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.947260:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422254976:0@lo:5: 00000004:00080000:0.0:1789023955.947282:0:9982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789023955.947313:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422255104:0@lo:5: 00000100:00100000:0.0:1789023955.947337:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.947361:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.947781:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255104 00000100:00100000:3.0:1789023955.947787:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255104 00000100:00100000:3.0:1789023955.947823:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789023955.947830:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9982:x1875927422255104:12345-0@lo:5: 00002000:00080000:3.0:1789023955.947858:0:8904:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789023955.950846:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9982:x1875927422255104:12345-0@lo:5: Request processed in 3009us (3501us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789023955.950860:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789023955.951086:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc81f80 x1875927422255104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.951103:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9982:1875927422255104:0@lo:5: 00000004:00080000:0.0:1789023955.951118:0:9982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789023955.951271:0:9982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9982:1875927422255232:0@lo:900: 00000100:00100000:0.0:1789023955.951308:0:9982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023955.951368:0:9982:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.951412:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255232 00000100:00100000:3.0:1789023955.951420:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255232 00000100:00100000:3.0:1789023955.951507:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023955.951518:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9982:x1875927422255232:12345-0@lo:900: 00000100:00100000:3.0:1789023955.951686:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9982:x1875927422255232:12345-0@lo:900: Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.951694:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789023955.951760:0:9982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc83480 x1875927422255232/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023955.951770:0:9982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9982:1875927422255232:0@lo:900: 00000001:00080000:1.0:1789023955.960870:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:1.0:1789023955.960895:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1789023955.961355:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9986:x1875927422254848:12345-0@lo:700: Request processed in 16470us (16647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023955.961369:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789023955.961661:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021d2d80 x1875927422254848/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023955.961674:0:9986:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789023955.961693:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422254848:0@lo:700: 00000004:02000040:1.0:1789023955.968265:0:9986:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1789023955.973064:0:9986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422255360:0@lo:5: 00000100:00100000:1.0:1789023955.973134:0:9986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023955.973314:0:9986:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023955.973685:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255360 00000100:00100000:3.0:1789023955.973693:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255360 00000100:00100000:3.0:1789023955.973813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023955.973823:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9986:x1875927422255360:12345-0@lo:5: 00002000:00080000:0.0:1789023955.977800:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789023955.977824:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789023955.979925:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9986:x1875927422255360:12345-0@lo:5: Request processed in 6096us (6782us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789023955.979938:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789023955.980028:0:9986:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf94e00 x1875927422255360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023955.980059:0:9986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9986:1875927422255360:0@lo:5: 00000004:00080000:1.0:1789023955.980075:0:9986:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1789023956.812748:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789023956.862009:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789023957.390027:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023957.390052:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422255488:0@lo:41: 00000100:00100000:3.0:1789023957.390123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023957.390567:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255488 00000100:00100000:0.0:1789023957.390577:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255488 00000100:00100000:0.0:1789023957.390634:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789023957.390645:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422255488:12345-0@lo:41: 00000004:00000024:0.0:1789023957.390685:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789023957.390751:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422255488:12345-0@lo:41: Request processed in 107us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023957.390759:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789023957.391051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422255488:0@lo:41: 00000020:00000004:1.0:1789023957.582283:0:10037:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023957.582619:0:10037:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789023957.836430:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789023958.234089:0:10085:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789023958.234100:0:10085:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1789023958.667781:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023958.667891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283136 00000100:00100000:3.0:1789023958.667901:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283136 00000100:00100000:3.0:1789023958.667943:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 180 00000100:00100000:3.0:1789023958.667952:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875927402283136:12345-192.168.202.18@tcp:250: 00010000:00080000:3.0:1789023958.667980:0:6510:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 14ec32b5-f959-4605-b464-02aeac6020b2@192.168.202.18@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1789023958.668013:0:6510:0:(genops.c:1384:class_connect()) connect: client 14ec32b5-f959-4605-b464-02aeac6020b2, cookie 0xa736ef4b98cb3604 00000100:00080000:3.0:1789023958.668138:0:6510:0:(import.c:65:import_set_state_nolock()) ffff90cc35438800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023958.668240:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+5:2399:x1875927402283136:12345-192.168.202.18@tcp:250: Request processed in 288us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023958.668248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 180 00000100:00100000:2.0:1789023958.677584:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.677930:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283264 00000100:00100000:1.0:1789023958.677941:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283264 00000100:00100000:1.0:1789023958.678004:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:1.0:1789023958.678013:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+5:6160:x1875927402283264:12345-192.168.202.18@tcp:101: 00010000:00010000:1.0:1789023958.678031:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023958.678049:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af319 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.678079:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.678091:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.678099:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161c00, rc 0) 00000100:00100000:1.0:1789023958.678194:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+6:6160:x1875927402283264:12345-192.168.202.18@tcp:101: Request processed in 181us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.678200:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:0.0:1789023958.683725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023958.683835:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283392 00000100:00100000:2.0:1789023958.683845:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283392 00000100:00100000:2.0:1789023958.683911:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:2.0:1789023958.683922:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+6:6160:x1875927402283392:12345-192.168.202.18@tcp:501: 00000100:00100000:2.0:1789023958.684054:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+6:6160:x1875927402283392:12345-192.168.202.18@tcp:501: Request processed in 133us (338us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023958.684062:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:0.0:1789023958.691031:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023958.691222:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283520 00000100:00100000:3.0:1789023958.691233:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283520 00000100:00100000:3.0:1789023958.691283:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 183 00000100:00100000:3.0:1789023958.691293:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+6:6160:x1875927402283520:12345-192.168.202.18@tcp:101: 00010000:00010000:3.0:1789023958.691310:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023958.691327:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af320 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023958.691354:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023958.691384:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023958.691392:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031200, rc 0) 00000100:00100000:3.0:1789023958.691442:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+7:6160:x1875927402283520:12345-192.168.202.18@tcp:101: Request processed in 150us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023958.691449:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 183 00000100:00100000:3.0:1789023958.697258:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.697364:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283648 00000100:00100000:1.0:1789023958.697387:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283648 00000100:00100000:1.0:1789023958.697445:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 184 00000100:00100000:1.0:1789023958.697456:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+7:6160:x1875927402283648:12345-192.168.202.18@tcp:501: 00000100:00100000:1.0:1789023958.697632:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+8:6160:x1875927402283648:12345-192.168.202.18@tcp:501: Request processed in 177us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.697639:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 184 00000100:00100000:0.0:1789023958.699129:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023958.699245:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283776 00000100:00100000:2.0:1789023958.699254:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283776 00000100:00100000:2.0:1789023958.699306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 185 00000100:00100000:2.0:1789023958.699315:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+8:6160:x1875927402283776:12345-192.168.202.18@tcp:503: 00000100:00100000:2.0:1789023958.699449:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+8:6160:x1875927402283776:12345-192.168.202.18@tcp:503: Request processed in 135us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023958.699457:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 185 00000100:00100000:0.0:1789023958.702097:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023958.702393:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402283904 00000100:00100000:3.0:1789023958.702405:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402283904 00000100:00100000:3.0:1789023958.702458:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 186 00000100:00100000:3.0:1789023958.702469:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+8:6179:x1875927402283904:12345-192.168.202.18@tcp:502: 00000100:00100000:3.0:1789023958.702638:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+8:6179:x1875927402283904:12345-192.168.202.18@tcp:502: Request processed in 170us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023958.702645:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 186 00000100:00100000:3.0:1789023958.733796:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.733957:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284032 00000100:00100000:1.0:1789023958.733969:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284032 00000100:00100000:1.0:1789023958.734030:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 187 00000100:00100000:1.0:1789023958.734046:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+8:6179:x1875927402284032:12345-192.168.202.18@tcp:502: 00000100:00100000:1.0:1789023958.734389:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+8:6179:x1875927402284032:12345-192.168.202.18@tcp:502: Request processed in 343us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.734397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 187 00000100:00100000:0.0:1789023958.740404:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023958.742474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284160 00000100:00100000:2.0:1789023958.742489:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284160 00000100:00100000:2.0:1789023958.742562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 188 00000100:00100000:2.0:1789023958.742574:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+8:6160:x1875927402284160:12345-192.168.202.18@tcp:101: 00010000:00010000:2.0:1789023958.742593:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023958.742612:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0000/0xa736ef4b98cb3619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af351 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023958.742654:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0000/0xa736ef4b98cb3619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af351 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023958.742665:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0000/0xa736ef4b98cb3619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af351 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023958.742674:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0000, rc 0) 00000100:00100000:2.0:1789023958.742741:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+9:6160:x1875927402284160:12345-192.168.202.18@tcp:101: Request processed in 170us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023958.742748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 188 00000100:00100000:0.0:1789023958.759251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023958.759335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284288 00000100:00100000:3.0:1789023958.759346:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284288 00000100:00100000:3.0:1789023958.759400:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:3.0:1789023958.759411:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6160:x1875927402284288:12345-192.168.202.18@tcp:256: 20000000:01000000:3.0:1789023958.759437:0:6510:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789023958.759460:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789023958.759465:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789023958.759468:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789023958.759470:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789023958.759472:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789023958.761123:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6160:x1875927402284288:12345-192.168.202.18@tcp:256: Request processed in 1706us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023958.761135:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:0.0:1789023958.768995:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.773535:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284416 00000100:00100000:1.0:1789023958.773699:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284416 00000100:00100000:1.0:1789023958.773776:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:1.0:1789023958.773787:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6160:x1875927402284416:12345-192.168.202.18@tcp:101: 00010000:00010000:1.0:1789023958.773804:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023958.773825:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af358 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.773856:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.773867:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023958.773888:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160600, rc 0) 00000100:00100000:1.0:1789023958.774095:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6160:x1875927402284416:12345-192.168.202.18@tcp:101: Request processed in 309us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.774104:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:0.0:1789023958.780334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023958.780395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284544 00000100:00100000:2.0:1789023958.780406:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284544 00000100:00100000:2.0:1789023958.780516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:2.0:1789023958.780527:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6160:x1875927402284544:12345-192.168.202.18@tcp:501: 00000100:00100000:2.0:1789023958.780688:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6160:x1875927402284544:12345-192.168.202.18@tcp:501: Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023958.780696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:3.0:1789023958.783450:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.785520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284672 00000100:00100000:1.0:1789023958.785535:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284672 00000100:00100000:1.0:1789023958.785604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00100000:1.0:1789023958.785614:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6160:x1875927402284672:12345-192.168.202.18@tcp:503: 00000100:00100000:1.0:1789023958.785781:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6160:x1875927402284672:12345-192.168.202.18@tcp:503: Request processed in 167us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.785788:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00100000:1.0:1789023958.791005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.791041:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284800 00000100:00100000:1.0:1789023958.791051:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284800 00000100:00100000:1.0:1789023958.791092:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 193 00000100:00100000:1.0:1789023958.791101:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6183:x1875927402284800:12345-192.168.202.18@tcp:502: 00000100:00100000:1.0:1789023958.791277:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6183:x1875927402284800:12345-192.168.202.18@tcp:502: Request processed in 175us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.791284:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 193 00000100:00100000:2.0:1789023958.794024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.795009:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402284928 00000100:00100000:1.0:1789023958.795021:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402284928 00000100:00100000:1.0:1789023958.795085:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 194 00000100:00100000:1.0:1789023958.795096:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6183:x1875927402284928:12345-192.168.202.18@tcp:502: 00000100:00100000:1.0:1789023958.795296:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6183:x1875927402284928:12345-192.168.202.18@tcp:502: Request processed in 201us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.795304:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 194 00000100:00100000:1.0:1789023958.799854:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023958.800070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285056 00000100:00100000:2.0:1789023958.800082:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285056 00000100:00100000:2.0:1789023958.800134:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:2.0:1789023958.800142:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875927402285056:12345-192.168.202.18@tcp:38: 00010000:00080000:2.0:1789023958.800218:0:6517:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1789023958.800266:0:6517:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb3627 00000004:00100000:2.0:1789023958.800290:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789023958.800510:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cb02533000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023958.800674:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402285056:12345-192.168.202.18@tcp:38: Request processed in 529us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023958.800682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:3.0:1789023958.806055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023958.806211:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285312 00000100:00100000:1.0:1789023958.806222:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285312 00000100:00100000:1.0:1789023958.806275:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:1.0:1789023958.806283:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1875927402285312:12345-192.168.202.18@tcp:38: 00010000:00080000:1.0:1789023958.806318:0:7824:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1789023958.806370:0:7824:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb362e 00000004:00100000:1.0:1789023958.806392:0:7824:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789023958.806634:0:7824:0:(import.c:65:import_set_state_nolock()) ffff90cb03352800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023958.806710:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402285312:12345-192.168.202.18@tcp:38: Request processed in 422us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023958.806717:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 8 00010000:00010000:3.0:1789023958.860357:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023959.436617:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422255616:0@lo:41: 00000100:00100000:3.0:1789023959.436694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023959.437133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255616 00000100:00100000:0.0:1789023959.437142:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255616 00000100:00100000:0.0:1789023959.437256:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789023959.437264:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422255616:12345-0@lo:41: 00000004:00000024:0.0:1789023959.437295:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789023959.437359:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422255616:12345-0@lo:41: Request processed in 95us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023959.437366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789023959.437568:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422255616:0@lo:41: 00000100:00100000:0.0:1789023959.806503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023959.806626:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023959.806694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285184 00000100:00100000:2.0:1789023959.806707:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285184 00000100:00100000:0.0:1789023959.806717:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00080000:3.0:1789023959.806829:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023959.806962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285568 00000100:00100000:2.0:1789023959.806965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285440 00000100:00100000:2.0:1789023959.806967:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285440 00000100:00100000:1.0:1789023959.806967:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285568 00000100:00100000:0.0:1789023959.807013:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:3.0:1789023959.807021:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:0.0:1789023959.807024:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:0:x1875927402285184:12345-192.168.202.18@tcp:41: 00000100:00100000:3.0:1789023959.807028:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:6160:x1875927402285568:12345-192.168.202.18@tcp:41: 00000004:00000024:0.0:1789023959.807063:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:3.0:1789023959.807064:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789023959.807133:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:6160:x1875927402285568:12345-192.168.202.18@tcp:41: Request processed in 105us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023959.807133:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:0:x1875927402285184:12345-192.168.202.18@tcp:41: Request processed in 110us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023959.807140:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:3.0:1789023959.807143:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:3.0:1789023959.807207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:3.0:1789023959.807214:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:0:x1875927402285440:12345-192.168.202.18@tcp:41: 00000004:00000024:3.0:1789023959.807226:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789023959.807261:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:0:x1875927402285440:12345-192.168.202.18@tcp:41: Request processed in 37us (533us total) trans 0 rc 0/0 00000100:00080000:2.0:1789023959.807501:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789023959.807752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:1.0:1789023959.810267:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023959.810676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285696 00000100:00100000:0.0:1789023959.810685:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285696 00000100:00100000:0.0:1789023959.810737:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:0.0:1789023959.810761:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402285696:12345-192.168.202.18@tcp:40: 00000100:00100000:0.0:1789023959.811007:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402285696:12345-192.168.202.18@tcp:40: Request processed in 145us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023959.811017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:1.0:1789023959.814920:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023959.814963:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023959.814995:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023959.816255:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285824 00000100:00100000:0.0:1789023959.816269:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285824 00000100:00100000:0.0:1789023959.816322:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402285952 00000100:00100000:0.0:1789023959.816325:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402285952 00000100:00100000:0.0:1789023959.816349:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:0.0:1789023959.816357:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2399:x1875927402285824:12345-192.168.202.18@tcp:8: 00010000:00080000:0.0:1789023959.816403:0:8431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 277 last 0 00000100:00100000:3.0:1789023959.816617:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286080 00000100:00100000:3.0:1789023959.816623:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286080 00000020:00000080:0.0:1789023959.816656:0:8431:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb3635 00000100:00100000:3.0:1789023959.816661:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:3.0:1789023959.816668:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402286080:12345-192.168.202.18@tcp:900: 00002000:00100000:0.0:1789023959.816668:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 382f7d83-ada1-4b7e-b952-8068d9fee082/ffff90cc3bf98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789023959.816686:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789023959.816742:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402286080:12345-192.168.202.18@tcp:900: Request processed in 74us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023959.816763:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:2.0:1789023959.817015:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:2.0:1789023959.817020:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875927402285952:12345-192.168.202.18@tcp:8: 00010000:00080000:2.0:1789023959.817040:0:8904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1789023959.817063:0:8904:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb363c 00002000:00100000:2.0:1789023959.817069:0:8904:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 382f7d83-ada1-4b7e-b952-8068d9fee082/ffff90cb02531800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023959.817200:0:8904:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789023959.817350:0:8904:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789023959.817378:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cb02536800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023959.817426:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402285952:12345-192.168.202.18@tcp:8: Request processed in 404us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023959.817433:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00002000:00080000:0.0:1789023959.818740:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789023959.819581:0:8431:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023959.819880:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402285824:12345-192.168.202.18@tcp:8: Request processed in 3518us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023959.819891:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:2.0:1789023959.821337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023959.821556:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023959.821971:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286336 00000100:00100000:0.0:1789023959.821981:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286336 00000100:00100000:0.0:1789023959.822032:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:0.0:1789023959.822042:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402286336:12345-192.168.202.18@tcp:33: 00000100:00100000:3.0:1789023959.825269:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286208 00000100:00100000:3.0:1789023959.825284:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286208 00000100:00100000:3.0:1789023959.825399:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 195 00000100:00100000:3.0:1789023959.825410:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402286208:12345-192.168.202.18@tcp:400: 00000100:00100000:3.0:1789023959.825497:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402286208:12345-192.168.202.18@tcp:400: Request processed in 89us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023959.825504:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 195 00000004:00080000:2.0:1789023959.836673:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14355us 00000004:00200000:2.0:1789023959.846206:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789023959.846324:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6160:x1875927402286336:12345-192.168.202.18@tcp:33: Request processed in 24276us (24761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023959.846340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00010000:00010000:3.0:1789023959.884313:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023959.989462:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023959.989630:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286464 00000100:00100000:1.0:1789023959.989640:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286464 00000100:00100000:1.0:1789023959.989738:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:1.0:1789023959.989748:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6201:x1875927402286464:12345-192.168.202.18@tcp:101: 00010000:00010000:1.0:1789023959.989769:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023959.989858:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161800/0xa736ef4b98cb3643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af389 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.989934:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.989967:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.989981:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023959.990033:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789023959.990037:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789023959.990055:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.990087:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161800/0xa736ef4b98cb3643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af389 expref: 8 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.990109:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af389 expref: 7 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023959.990118:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1c890400) 00010000:00010000:1.0:1789023959.990120:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789023959.990124:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161200, rc 0) 00000100:00100000:1.0:1789023959.990485:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:6201:x1875927402286464:12345-192.168.202.18@tcp:101: Request processed in 737us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023959.990493:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:1.0:1789023960.460529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422255744:0@lo:13: 00000100:00100000:1.0:1789023960.460617:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.460879:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023960.460888:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422255872:0@lo:13: 00000100:00100000:1.0:1789023960.460914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023960.461052:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255744 00000100:00100000:3.0:1789023960.461060:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255744 00000100:00100000:3.0:1789023960.461127:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422255872 00000100:00100000:3.0:1789023960.461130:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422255872 00000100:00100000:3.0:1789023960.461180:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023960.461189:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422255744:12345-0@lo:13: 00002000:00000024:3.0:1789023960.461220:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023960.461263:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422255744:12345-0@lo:13: Request processed in 76us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.461269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023960.461285:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023960.461291:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422255872:12345-0@lo:13: 00002000:00000024:3.0:1789023960.461301:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023960.461322:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422255872:12345-0@lo:13: Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.461328:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789023960.461438:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023960.461470:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bed80 x1875927422255872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023960.461490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422255872:0@lo:13: 00010000:00080000:1.0:1789023960.461503:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0a80 x1875927422255744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023960.461514:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422255744:0@lo:13: 00010000:00010000:1.0:1789023960.908371:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023960.972482:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023960.972526:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422256000:0@lo:13: 00000100:00100000:3.0:1789023960.972596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023960.972733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256000 00000100:00100000:0.0:1789023960.972743:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256000 00000100:00100000:0.0:1789023960.972827:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023960.972838:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422256000:12345-0@lo:13: 00002000:00000024:0.0:1789023960.972869:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023960.972922:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422256000:12345-0@lo:13: Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023960.972930:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789023960.972972:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc355b5500 x1875927422256000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023960.972983:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789023960.973004:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422256000:0@lo:13: 00000100:00080000:1.0:1789023960.973111:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023960.974190:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422256512:0@lo:400: 00000100:00100000:2.0:1789023960.974261:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974297:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422257024:0@lo:400: 00000100:00100000:2.0:1789023960.974323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974349:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422257536:0@lo:400: 00000100:00100000:1.0:1789023960.974366:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422256256:0@lo:400: 00000100:00100000:2.0:1789023960.974370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974393:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789023960.974393:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974398:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422256128:0@lo:400: 00000100:00100000:1.0:1789023960.974411:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422256768:0@lo:400: 00000100:00100000:2.0:1789023960.974423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.974429:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974440:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422256640:0@lo:400: 00000100:00100000:1.0:1789023960.974442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422257280:0@lo:400: 00000100:00100000:1.0:1789023960.974459:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.974466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.974473:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789023960.974479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422256384:0@lo:400: 00000100:00100000:1.0:1789023960.974506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256512 00000100:00100000:1.0:1789023960.974511:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256512 00000100:00100000:1.0:1789023960.974541:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256256 00000100:00100000:1.0:1789023960.974544:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256256 00000100:00100000:1.0:1789023960.974556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256768 00000100:00100000:1.0:1789023960.974560:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256768 00000100:00100000:1.0:1789023960.974580:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257280 00000100:00100000:1.0:1789023960.974582:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257280 00000100:00100000:1.0:1789023960.974597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789023960.974603:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422256512:12345-0@lo:400: 00000100:00100000:3.0:1789023960.974651:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789023960.974659:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422256256:12345-0@lo:400: 00000100:00100000:1.0:1789023960.974664:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422256512:12345-0@lo:400: Request processed in 62us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.974671:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789023960.974686:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023960.974692:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422256768:12345-0@lo:400: 00000100:00100000:3.0:1789023960.974693:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422256256:12345-0@lo:400: Request processed in 36us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.974699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789023960.974710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789023960.974715:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422256768:12345-0@lo:400: Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.974716:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422257280:12345-0@lo:400: 00000100:00100000:1.0:1789023960.974720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789023960.974739:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422257280:12345-0@lo:400: Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.974745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789023960.974748:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023960.974778:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257024 00000100:00100000:3.0:1789023960.974779:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257536 00000100:00100000:3.0:1789023960.974781:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257536 00000100:00100000:1.0:1789023960.974781:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257024 00000100:00100000:1.0:1789023960.974803:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023960.974806:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023960.974808:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422257024:12345-0@lo:400: 00000100:00100000:3.0:1789023960.974824:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422257536:12345-0@lo:400: 00000100:00100000:1.0:1789023960.974836:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422257024:12345-0@lo:400: Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.974842:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023960.974847:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422257536:12345-0@lo:400: Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.974853:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789023960.974858:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023960.974953:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422257152:0@lo:400: 00000100:00100000:2.0:1789023960.974977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.975239:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422256512:0@lo:400: 00010000:00080000:2.0:1789023960.975251:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90fb80 x1875927422257024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023960.975261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422257024:0@lo:400: 00010000:00080000:2.0:1789023960.975270:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90d180 x1875927422257536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023960.975276:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789023960.975288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422257536:0@lo:400: 00000100:00100000:2.0:1789023960.975311:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256640 00000100:00100000:2.0:1789023960.975315:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256640 00000100:00100000:2.0:1789023960.975342:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789023960.975349:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422256640:12345-0@lo:400: 00000100:00100000:2.0:1789023960.975385:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422256640:12345-0@lo:400: Request processed in 37us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023960.975391:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789023960.975416:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422256640:0@lo:400: 00000100:00100000:0.0:1789023960.975654:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256128 00000100:00100000:0.0:1789023960.975659:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256128 00000100:00100000:0.0:1789023960.975688:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789023960.975695:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422256128:12345-0@lo:400: 00000100:00100000:0.0:1789023960.975724:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422256128:12345-0@lo:400: Request processed in 30us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023960.975729:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789023960.977024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.977065:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422256896:0@lo:400: 00000100:00100000:1.0:1789023960.977107:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.977127:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422257408:0@lo:400: 00000100:00100000:1.0:1789023960.977182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023960.977222:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422256256:0@lo:400: 00000100:00100000:1.0:1789023960.977235:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422256768:0@lo:400: 00000100:00100000:1.0:1789023960.977246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422257280:0@lo:400: 00000100:00100000:1.0:1789023960.977295:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256896 00000100:00100000:1.0:1789023960.977300:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256896 00000100:00100000:1.0:1789023960.977353:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257408 00000100:00100000:1.0:1789023960.977356:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257408 00000100:00100000:1.0:1789023960.977378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789023960.977385:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422256896:12345-0@lo:400: 00000100:00100000:1.0:1789023960.977430:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422256896:12345-0@lo:400: Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.977436:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789023960.977452:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789023960.977458:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422257408:12345-0@lo:400: 00000100:00100000:1.0:1789023960.977484:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422257408:12345-0@lo:400: Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.977489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789023960.977505:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789023960.977532:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90df80 x1875927422256896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023960.977544:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422256896:0@lo:400: 00010000:00080000:1.0:1789023960.977554:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ea00 x1875927422257408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023960.977561:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422257408:0@lo:400: 00000100:00100000:1.0:1789023960.977596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422256384 00000100:00100000:1.0:1789023960.977600:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422256384 00000100:00100000:1.0:1789023960.977625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789023960.977631:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422256384:12345-0@lo:400: 00000100:00100000:1.0:1789023960.977667:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422256384:12345-0@lo:400: Request processed in 35us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.977680:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789023960.977705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422256384:0@lo:400: 00000100:00100000:2.0:1789023960.981270:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422257664:0@lo:13: 00000100:00100000:2.0:1789023960.981352:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023960.981452:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422256128:0@lo:400: 00000100:00100000:1.0:1789023960.985640:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257664 00000100:00100000:1.0:1789023960.985657:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257664 00000100:00100000:1.0:1789023960.985747:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789023960.985759:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422257664:12345-0@lo:13: 00002000:00000024:1.0:1789023960.985787:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023960.985871:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422257664:12345-0@lo:13: Request processed in 115us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023960.985878:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789023960.986325:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a2300 x1875927422257664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023960.986368:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422257664:0@lo:13: 00000100:00100000:3.0:1789023960.988806:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257152 00000100:00100000:3.0:1789023960.988892:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257152 00000100:00100000:3.0:1789023960.988967:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023960.988977:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422257152:12345-0@lo:400: 00000100:00100000:3.0:1789023960.990332:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422257152:12345-0@lo:400: Request processed in 1353us (15349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023960.990343:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789023960.990490:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ca80 x1875927422257152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023960.990505:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422257152:0@lo:400: 00000100:00100000:2.0:1789023961.856416:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023961.856526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286592 00000100:00100000:1.0:1789023961.856536:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286592 00000100:00100000:1.0:1789023961.856650:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:1.0:1789023961.856661:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:6253:x1875927402286592:12345-192.168.202.18@tcp:41: 00000004:00000024:1.0:1789023961.856720:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789023961.856913:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:6253:x1875927402286592:12345-192.168.202.18@tcp:41: Request processed in 253us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023961.856922:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00080000:2.0:1789023961.857485:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023961.862958:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023961.863404:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286720 00000100:00100000:1.0:1789023961.863415:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286720 00000100:00080000:2.0:1789023961.863556:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789023961.863607:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:1.0:1789023961.863619:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286720:12345-192.168.202.18@tcp:41: 00000004:00000024:1.0:1789023961.863668:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789023961.863758:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286720:12345-192.168.202.18@tcp:41: Request processed in 140us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023961.863775:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:0.0:1789023961.867579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023961.867680:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286848 00000100:00100000:1.0:1789023961.867689:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286848 00000100:00100000:1.0:1789023961.867821:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789023961.867832:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286848:12345-192.168.202.18@tcp:13: 00002000:00000024:1.0:1789023961.867864:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023961.867935:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286848:12345-192.168.202.18@tcp:13: Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023961.867943:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00080000:2.0:1789023961.868398:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023961.870005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023961.870355:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402286976 00000100:00100000:1.0:1789023961.870364:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402286976 00000100:00100000:1.0:1789023961.870471:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:1.0:1789023961.870481:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286976:12345-192.168.202.18@tcp:13: 00002000:00000024:1.0:1789023961.870503:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023961.870567:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:382f7d83-ada1-4b7e-b952-8068d9fee082+6:6253:x1875927402286976:12345-192.168.202.18@tcp:13: Request processed in 88us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023961.870574:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00080000:2.0:1789023961.871662:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789023961.934216:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023962.518045:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422257792:0@lo:41: 00000100:00100000:1.0:1789023962.518121:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023962.518989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257792 00000100:00100000:2.0:1789023962.519000:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257792 00000100:00100000:2.0:1789023962.519075:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789023962.519086:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422257792:12345-0@lo:41: 00000004:00000024:2.0:1789023962.519122:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789023962.530763:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422257792:12345-0@lo:41: Request processed in 11669us (12632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023962.530778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789023962.539586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422257792:0@lo:41: 00010000:00010000:3.0:1789023962.956764:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023963.981825:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789023964.061547:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:2.0:1789023964.562748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422257920:0@lo:41: 00000100:00100000:2.0:1789023964.562998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023964.563282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422257920 00000100:00100000:0.0:1789023964.563294:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422257920 00000100:00100000:0.0:1789023964.563358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789023964.563370:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422257920:12345-0@lo:41: 00000004:00000024:0.0:1789023964.563423:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789023964.567443:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422257920:12345-0@lo:41: Request processed in 4061us (4433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023964.567462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789023964.569370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422257920:0@lo:41: 00000001:02000400:0.0:1789023964.889858:0:10183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789023965.017403:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789023965.083310:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000001:00100000:0.0:1789023965.086531:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:0.0:1789023965.204964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023965.205005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023965.205355:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287104 00000100:00100000:3.0:1789023965.205367:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287104 00000100:00100000:3.0:1789023965.205417:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 197 00000100:00100000:3.0:1789023965.205427:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402287104:12345-192.168.202.18@tcp:400: 00000100:00100000:3.0:1789023965.205496:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402287104:12345-192.168.202.18@tcp:400: Request processed in 71us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023965.205502:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 197 00000100:00100000:2.0:1789023965.207952:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023965.207989:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023965.208036:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287616 00000100:00100000:3.0:1789023965.208045:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287616 00000100:00100000:3.0:1789023965.208134:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:3.0:1789023965.208163:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402287616:12345-192.168.202.18@tcp:400: 00000100:00100000:3.0:1789023965.208227:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402287616:12345-192.168.202.18@tcp:400: Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023965.208234:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00080000:0.0:1789023965.208435:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023965.214680:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287360 00000100:00100000:1.0:1789023965.214695:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287360 00000100:00100000:0.0:1789023965.214870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:0.0:1789023965.214884:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402287360:12345-192.168.202.18@tcp:400: 00000100:00100000:0.0:1789023965.214983:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402287360:12345-192.168.202.18@tcp:400: Request processed in 102us (9976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023965.214991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00080000:1.0:1789023965.215782:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789023965.218935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023965.219186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287232 00000100:00100000:0.0:1789023965.219197:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287232 00000100:00100000:0.0:1789023965.219264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:0.0:1789023965.219274:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402287232:12345-192.168.202.18@tcp:400: 00000100:00100000:0.0:1789023965.219358:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402287232:12345-192.168.202.18@tcp:400: Request processed in 85us (11368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023965.219366:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00080000:0.0:1789023965.219395:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023965.220441:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287488 00000100:00100000:1.0:1789023965.220452:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287488 00000100:00100000:1.0:1789023965.220539:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:1.0:1789023965.220550:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402287488:12345-192.168.202.18@tcp:400: 00000100:00100000:1.0:1789023965.220613:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402287488:12345-192.168.202.18@tcp:400: Request processed in 65us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023965.220619:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00080000:0.0:1789023965.220817:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023965.581098:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023965.581136:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422258176:0@lo:13: 00000100:00100000:2.0:1789023965.581228:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023965.581303:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422258048:0@lo:13: 00000100:00100000:2.0:1789023965.581328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023965.581584:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258176 00000100:00100000:0.0:1789023965.581594:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258176 00000100:00100000:3.0:1789023965.581601:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258048 00000100:00100000:3.0:1789023965.581605:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258048 00000100:00080000:1.0:1789023965.581661:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023965.581704:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023965.581714:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422258176:12345-0@lo:13: 00002000:00000024:0.0:1789023965.581756:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023965.581809:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422258176:12345-0@lo:13: Request processed in 97us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023965.581817:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789023965.581883:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90d880 x1875927422258176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023965.581902:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422258176:0@lo:13: 00000100:00100000:3.0:1789023965.588670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023965.588696:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422258048:12345-0@lo:13: 00002000:00000024:3.0:1789023965.588724:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023965.588892:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422258048:12345-0@lo:13: Request processed in 208us (7562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023965.588899:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789023965.591681:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a1f80 x1875927422258048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023965.592271:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422258048:0@lo:13: 00010000:00010000:3.0:1789023966.028934:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023966.092530:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422258304:0@lo:400: 00000100:00100000:3.0:1789023966.092639:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023966.093368:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258304 00000100:00100000:0.0:1789023966.093380:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258304 00000100:00100000:0.0:1789023966.093435:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789023966.093446:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422258304:12345-0@lo:400: 00000100:00100000:0.0:1789023966.096903:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422258304:12345-0@lo:400: Request processed in 3445us (4250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023966.096925:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789023966.097205:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422258688:0@lo:400: 00000100:00100000:0.0:1789023966.097347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023966.097428:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422259200:0@lo:400: 00000100:00100000:0.0:1789023966.097458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.098112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258688 00000100:00100000:1.0:1789023966.098125:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258688 00000100:00100000:0.0:1789023966.098394:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422259712:0@lo:400: 00000100:00100000:0.0:1789023966.098444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099305:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789023966.099322:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422258688:12345-0@lo:400: 00000100:00100000:1.0:1789023966.099398:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422258688:12345-0@lo:400: Request processed in 82us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.099405:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789023966.099457:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422258560:0@lo:400: 00000100:00100000:1.0:1789023966.099503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099530:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422259072:0@lo:400: 00000100:00100000:1.0:1789023966.099567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099586:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422259584:0@lo:400: 00000100:00100000:1.0:1789023966.099606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099623:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422260096:0@lo:13: 00000100:00100000:1.0:1789023966.099646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099701:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259072 00000100:00100000:1.0:1789023966.099717:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259072 00000100:00100000:1.0:1789023966.099757:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259584 00000100:00100000:1.0:1789023966.099761:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259584 00000100:00100000:1.0:1789023966.099800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789023966.099806:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422259072:12345-0@lo:400: 00000100:00100000:1.0:1789023966.099844:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422259072:12345-0@lo:400: Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.099850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789023966.099864:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789023966.099870:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422259584:12345-0@lo:400: 00000100:00100000:1.0:1789023966.099895:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422259584:12345-0@lo:400: Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.099901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789023966.099923:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422258432:0@lo:400: 00000100:00100000:1.0:1789023966.099949:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.099979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422258944:0@lo:400: 00000100:00100000:1.0:1789023966.100001:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.100013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422259456:0@lo:400: 00000100:00100000:1.0:1789023966.100046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.100096:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422259968:0@lo:13: 00000100:00100000:1.0:1789023966.100174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789023966.100205:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789023966.100216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258432 00000100:00100000:1.0:1789023966.100219:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258432 00000100:00100000:1.0:1789023966.100236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258944 00000100:00100000:1.0:1789023966.100240:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258944 00000100:00100000:1.0:1789023966.100256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259456 00000100:00100000:1.0:1789023966.100265:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259456 00000100:00100000:1.0:1789023966.100283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789023966.100289:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422258432:12345-0@lo:400: 00000100:00100000:1.0:1789023966.100322:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422258432:12345-0@lo:400: Request processed in 34us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.100328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789023966.100341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789023966.100347:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422258944:12345-0@lo:400: 00000100:00100000:1.0:1789023966.100375:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422258944:12345-0@lo:400: Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.100380:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789023966.100392:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789023966.100398:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422259456:12345-0@lo:400: 00000100:00100000:1.0:1789023966.100422:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422259456:12345-0@lo:400: Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.100427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789023966.100439:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023966.100473:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90d500 x1875927422259072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023966.100489:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422259072:0@lo:400: 00010000:00080000:1.0:1789023966.100499:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ed80 x1875927422259584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023966.100507:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422259584:0@lo:400: 00000100:00100000:1.0:1789023966.100534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422258432:0@lo:400: 00000100:00100000:1.0:1789023966.100542:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422258944:0@lo:400: 00000100:00100000:1.0:1789023966.100561:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422259456:0@lo:400: 00000100:00100000:1.0:1789023966.100606:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260096 00000100:00100000:1.0:1789023966.100610:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260096 00000100:00100000:1.0:1789023966.100638:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259968 00000100:00100000:1.0:1789023966.100641:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259968 00000100:00100000:1.0:1789023966.100654:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789023966.100660:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422260096:12345-0@lo:13: 00002000:00000024:1.0:1789023966.100687:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023966.100727:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422260096:12345-0@lo:13: Request processed in 67us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.100734:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789023966.100746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023966.100752:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422259968:12345-0@lo:13: 00002000:00000024:1.0:1789023966.100762:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023966.100790:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422259968:12345-0@lo:13: Request processed in 38us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.100796:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789023966.100809:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789023966.100825:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a1f80 x1875927422259968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023966.100841:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422259968:0@lo:13: 00010000:00080000:1.0:1789023966.100864:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0380 x1875927422260096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023966.100876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422260096:0@lo:13: 00000100:00100000:2.0:1789023966.101126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258560 00000100:00100000:2.0:1789023966.101132:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258560 00000100:00100000:2.0:1789023966.101198:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789023966.101207:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422258560:12345-0@lo:400: 00000100:00100000:2.0:1789023966.101256:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422258560:12345-0@lo:400: Request processed in 50us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023966.101262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789023966.101361:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422258560:0@lo:400: 00000001:00100000:2.0:1789023966.102247:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:3.0:1789023966.108775:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259200 00000100:00100000:3.0:1789023966.108796:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259200 00000100:00100000:0.0:1789023966.108820:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422258688:0@lo:400: 00000100:00100000:3.0:1789023966.108868:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259712 00000100:00100000:3.0:1789023966.108872:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259712 00000100:00100000:3.0:1789023966.108899:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023966.108909:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422259200:12345-0@lo:400: 00000100:00100000:0.0:1789023966.108912:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023966.108918:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422259712:12345-0@lo:400: 00000100:00100000:2.0:1789023966.112753:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422258304:0@lo:400: 00000100:00100000:2.0:1789023966.112777:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422258816:0@lo:400: 00000100:00100000:1.0:1789023966.112829:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422259712:12345-0@lo:400: Request processed in 3907us (14379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023966.112837:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.112864:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023966.112881:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422258816 00000100:00100000:2.0:1789023966.112888:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422258816 00000100:00100000:2.0:1789023966.112935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789023966.112945:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422258816:12345-0@lo:400: 00000100:00100000:2.0:1789023966.113004:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422258816:12345-0@lo:400: Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023966.113010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789023966.113048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422258816:0@lo:400: 00000100:00100000:2.0:1789023966.113056:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422259328:0@lo:400: 00000100:00100000:2.0:1789023966.113082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023966.113121:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422259840:0@lo:400: 00000100:00100000:1.0:1789023966.113134:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259328 00000100:00100000:1.0:1789023966.113138:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259328 00000100:00100000:2.0:1789023966.113160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023966.113182:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422259840 00000100:00100000:2.0:1789023966.113186:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789023966.113186:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422259840 00000100:00100000:2.0:1789023966.113192:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422259328:12345-0@lo:400: 00000100:00100000:1.0:1789023966.113198:0:8433:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789023966.113207:0:8433:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789023966.113224:0:8431:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789023966.113225:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422259328:12345-0@lo:400: Request processed in 33us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023966.113230:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789023966.113281:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90dc00 x1875927422259712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023966.113294:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422259712:0@lo:400: 00000100:00100000:1.0:1789023966.113626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789023966.113635:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422259840:12345-0@lo:400: 00000100:00100000:1.0:1789023966.113746:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422259840:12345-0@lo:400: Request processed in 114us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023966.113753:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789023966.114202:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90c000 x1875927422259840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023966.114215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422259840:0@lo:400: 00010000:00080000:2.0:1789023966.114245:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ea00 x1875927422259328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023966.114253:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422259328:0@lo:400: 00000100:00100000:3.0:1789023966.116304:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422259200:12345-0@lo:400: Request processed in 7387us (18835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023966.116319:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789023966.116521:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90f100 x1875927422259200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023966.116548:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422259200:0@lo:400: 00010000:00010000:3.0:1789023967.053664:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023967.628569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422260224:0@lo:41: 00000100:00100000:3.0:1789023967.628675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023967.628783:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260224 00000100:00100000:3.0:1789023967.628794:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260224 00000100:00100000:3.0:1789023967.628858:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789023967.628868:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422260224:12345-0@lo:41: 00000004:00000024:3.0:1789023967.628914:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789023967.628972:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422260224:12345-0@lo:41: Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023967.628981:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789023967.629045:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422260224:0@lo:41: 00010000:00010000:3.0:1789023968.079282:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023969.104144:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789023969.166922:0:10331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebf7ffb50 20000000:00000080:2.0:1789023969.166943:0:10331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb024a7000 uarg=0000000000000000 20000000:01000000:2.0:1789023969.167004:0:10331:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789023969.167007:0:10331:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789023969.167010:0:10331:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789023969.167015:0:10331:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789023969.167021:0:10331:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789023969.167102:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789023969.167105:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789023969.172028:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789023969.173097:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789023969.173134:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789023969.173183:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789023969.173208:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789023969.173211:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789023969.173905:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789023969.174125:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1789023969.174664:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1789023969.174691:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1789023969.174704:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789023969.174707:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789023969.175140:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789023969.175744:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789023969.175771:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789023969.175786:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789023969.175796:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789023969.175799:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789023969.176106:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789023969.176627:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789023969.176655:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789023969.176669:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789023969.176679:0:10331:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789023969.176681:0:10331:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789023969.176959:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789023969.177120:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789023969.177139:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789023969.177492:0:10331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1789023969.177509:0:10331:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789023969.177532:0:10331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177632:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177641:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177649:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177669:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177677:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177684:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177692:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177699:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177706:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177717:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177725:0:10331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177732:0:10331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177773:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177798:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 9 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.177815:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260352:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789023969.177983:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.177992:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.178000:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260480:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789023969.178029:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.178037:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.178045:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260608:0@lo:104: 00000100:00100000:3.0:1789023969.178094:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023969.178139:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.178182:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.178191:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260736:0@lo:104: 00000100:00100000:3.0:1789023969.178212:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023969.178249:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.178258:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 23 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.178266:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260864:0@lo:104: 00000100:00100000:3.0:1789023969.178287:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023969.178305:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.178313:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 23 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.178321:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260992:0@lo:104: 00000100:00100000:0.0:1789023969.178554:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260608 00000100:00100000:0.0:1789023969.178563:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260608 00000100:00100000:0.0:1789023969.178600:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260736 00000100:00100000:0.0:1789023969.178603:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260736 00000100:00100000:0.0:1789023969.178611:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260864 00000100:00100000:0.0:1789023969.178618:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260864 00000100:00100000:0.0:1789023969.178633:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023969.178641:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10331:x1875927422260608:12345-0@lo:104: 00010000:00010000:0.0:1789023969.178654:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178706:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023969.178711:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10331:x1875927422260608:12345-0@lo:104: Request processed in 71us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.178717:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023969.178735:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023969.178741:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10331:x1875927422260736:12345-0@lo:104: 00010000:00010000:0.0:1789023969.178748:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178778:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789023969.178783:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10331:x1875927422260736:12345-0@lo:104: Request processed in 43us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.178788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023969.178799:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789023969.178805:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422260864:12345-0@lo:104: 00010000:00010000:0.0:1789023969.178811:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178842:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789023969.178847:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422260864:12345-0@lo:104: Request processed in 43us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.178852:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789023969.178875:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789023969.178881:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178889:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.178893:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178902:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.178910:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.178916:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.178942:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178949:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.178968:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178976:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0600/0xa736ef4b98cb35ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35f6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178988:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023969.178992:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.178998:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.179001:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179013:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.179019:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.179024:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.179036:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179041:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.179047:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179053:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0800/0xa736ef4b98cb35cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35d3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179062:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023969.179065:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179084:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.179086:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179093:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.179099:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.179110:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.179123:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179129:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.179163:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179171:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5200/0xa736ef4b98cb35b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb35b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179181:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.179183:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.179185:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.179191:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.179196:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023969.179207:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422261120:0@lo:103: 00000100:00100000:0.0:1789023969.179240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.179265:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023969.179270:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422261248:0@lo:103: 00000100:00100000:0.0:1789023969.179303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.179349:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422261376:0@lo:103: 00000100:00100000:0.0:1789023969.179373:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.179407:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261120 00000100:00100000:0.0:1789023969.179411:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261120 00010000:00010000:0.0:1789023969.179429:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 24 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023969.179460:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261248 00000100:00100000:0.0:1789023969.179463:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261248 00010000:00010000:0.0:1789023969.179473:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 25 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023969.179483:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261376 00000100:00100000:0.0:1789023969.179485:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261376 00010000:00010000:0.0:1789023969.179493:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 26 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023969.179504:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023969.179510:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+26:3643:x1875927422261120:12345-0@lo:103: 00010000:00010000:0.0:1789023969.179518:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023969.179523:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 26 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179532:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 26 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179547:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023969.179574:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f196c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+26:3643:x1875927422261120:12345-0@lo:103: Request processed in 63us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.179580:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023969.179616:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023969.179622:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422261248:12345-0@lo:103: 00010000:00010000:0.0:1789023969.179629:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023969.179632:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 25 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179650:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 25 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179660:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023969.179679:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422261248:12345-0@lo:103: Request processed in 58us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.179686:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023969.179698:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789023969.179703:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422261376:12345-0@lo:103: 00010000:00010000:0.0:1789023969.179711:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023969.179715:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 24 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179722:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 24 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.179731:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023969.179753:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422261376:12345-0@lo:103: Request processed in 49us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.179759:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789023969.179796:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422261376:0@lo:103: 00000100:00100000:0.0:1789023969.179815:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422261248:0@lo:103: 00000100:00100000:0.0:1789023969.179821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422261120:0@lo:103: 00000100:00100000:3.0:1789023969.180110:0:10331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023969.180174:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.180184:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.180193:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261504:0@lo:104: 00010000:00010000:3.0:1789023969.180224:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.180231:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 23 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.180238:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261632:0@lo:104: 00010000:00010000:3.0:1789023969.180269:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.180278:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.180285:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261760:0@lo:104: 00010000:00010000:3.0:1789023969.180318:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.180327:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.184114:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261888:0@lo:104: 00010000:00010000:3.0:1789023969.184231:0:10331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023969.184247:0:10331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 23 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.184256:0:10331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422262016:0@lo:104: 00000100:00100000:3.0:1789023969.184275:0:10331:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d56c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789023969.184305:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb35f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb35ef expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.184323:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260608:0@lo:104: 00010000:00010000:3.0:1789023969.184345:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4600/0xa736ef4b98cb35d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb35cc expref: 22 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.184352:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260736:0@lo:104: 00010000:00010000:3.0:1789023969.184382:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb35b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb35b0 expref: 21 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.184391:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260864:0@lo:104: 00000100:00100000:0.0:1789023969.184500:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789023969.184531:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023969.184676:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422260992 00000100:00100000:1.0:1789023969.184683:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422260992 00000100:00100000:1.0:1789023969.184726:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023969.184735:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb024a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422260992:12345-0@lo:104: 00010000:00010000:1.0:1789023969.184750:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184813:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023969.184819:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb024a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422260992:12345-0@lo:104: Request processed in 87us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.184825:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789023969.184888:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023969.184894:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184902:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789023969.184906:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184915:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023969.184922:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023969.184928:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023969.184955:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184961:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023969.184980:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184987:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4c00/0xa736ef4b98cb3586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb358d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.184997:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023969.184999:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023969.185001:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023969.185011:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422262144:0@lo:103: 00000100:00100000:1.0:1789023969.185039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023969.185089:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262144 00000100:00100000:1.0:1789023969.185098:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262144 00010000:00010000:1.0:1789023969.185114:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 21 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.185137:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023969.185165:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+21:3642:x1875927422262144:12345-0@lo:103: 00010000:00010000:1.0:1789023969.185175:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.185180:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 21 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.185189:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 21 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.185204:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.185231:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2a60d918-c836-4e5c-bd08-febd347ea726+21:3642:x1875927422262144:12345-0@lo:103: Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.185238:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023969.185267:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422262144:0@lo:103: 00010000:00010000:3.0:1789023969.185358:0:10331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb358d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3586 expref: 20 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.185367:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260992:0@lo:104: 00000100:00100000:0.0:1789023969.185441:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.185459:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.185472:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.185481:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.185487:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261504 00000100:00100000:0.0:1789023969.185491:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261504 00000100:00100000:0.0:1789023969.185510:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261632 00000100:00100000:0.0:1789023969.185512:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261632 00000100:00100000:0.0:1789023969.185522:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261760 00000100:00100000:0.0:1789023969.185524:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261760 00000100:00100000:0.0:1789023969.185532:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422261888 00000100:00100000:0.0:1789023969.185595:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422261888 00000100:00100000:0.0:1789023969.185611:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262016 00000100:00100000:0.0:1789023969.185614:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262016 00000100:00100000:0.0:1789023969.185627:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789023969.185633:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+7:10331:x1875927422261504:12345-0@lo:104: 00010000:00010000:0.0:1789023969.185641:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185688:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023969.185693:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+7:10331:x1875927422261504:12345-0@lo:104: Request processed in 61us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.185698:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789023969.185713:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023969.185719:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:10331:x1875927422261632:12345-0@lo:104: 00010000:00010000:0.0:1789023969.185726:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185756:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789023969.185760:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:10331:x1875927422261632:12345-0@lo:104: Request processed in 42us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.185775:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023969.185788:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023969.185793:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10331:x1875927422261760:12345-0@lo:104: 00010000:00010000:0.0:1789023969.185801:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185832:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789023969.185836:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10331:x1875927422261760:12345-0@lo:104: Request processed in 44us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.185841:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023969.185853:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023969.185858:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10331:x1875927422261888:12345-0@lo:104: 00010000:00010000:0.0:1789023969.185864:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185892:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789023969.185896:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10331:x1875927422261888:12345-0@lo:104: Request processed in 39us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.185901:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023969.185911:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023969.185916:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422262016:12345-0@lo:104: 00010000:00010000:0.0:1789023969.185922:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185946:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789023969.185950:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10331:x1875927422262016:12345-0@lo:104: Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.185961:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789023969.185976:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789023969.185981:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185987:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.185990:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.185998:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.186004:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.186009:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.186029:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186035:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.186049:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186055:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb356a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3571 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186067:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789023969.186081:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186096:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.186099:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186105:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.186110:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.186114:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.186127:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186132:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.186138:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186165:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0200/0xa736ef4b98cb355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3563 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186175:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789023969.186178:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186183:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.186186:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186202:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.186209:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.186214:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.186226:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186230:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.186239:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186246:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a160800/0xa736ef4b98cb354e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3555 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186254:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023969.186257:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186262:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.186265:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186271:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.186277:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.186287:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.186298:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186303:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.186308:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186315:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a160000/0xa736ef4b98cb350f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3516 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186325:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023969.186328:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186334:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789023969.186337:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186344:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023969.186351:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023969.186356:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023969.186366:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186371:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023969.186381:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186386:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a160a00/0xa736ef4b98cb34e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb34ec expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.186398:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.186399:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.186401:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.186408:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023969.186412:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023969.186422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262272:0@lo:103: 00000100:00100000:0.0:1789023969.186449:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.186475:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262784:0@lo:103: 00000100:00100000:0.0:1789023969.186490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.186506:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023969.186511:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262400:0@lo:103: 00000100:00100000:0.0:1789023969.186530:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023969.186660:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422262656:0@lo:103: 00000100:00100000:1.0:1789023969.186690:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422262528:0@lo:103: 00000100:00100000:1.0:1789023969.186711:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023969.186790:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261504:0@lo:104: 00000100:00100000:3.0:1789023969.186801:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261632:0@lo:104: 00000100:00100000:3.0:1789023969.186809:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261760:0@lo:104: 00000100:00100000:3.0:1789023969.186816:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422261888:0@lo:104: 00000100:00100000:3.0:1789023969.186823:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422262016:0@lo:104: 00000100:00100000:3.0:1789023969.186924:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023969.187805:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262272 00000100:00100000:1.0:1789023969.187813:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262272 00010000:00010000:1.0:1789023969.187842:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 20 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.187876:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262784 00000100:00100000:1.0:1789023969.187879:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262784 00010000:00010000:1.0:1789023969.187892:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 21 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.187914:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262400 00000100:00100000:1.0:1789023969.187916:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262400 00010000:00010000:1.0:1789023969.187929:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 22 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.187938:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262528 00000100:00100000:1.0:1789023969.187941:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262528 00010000:00010000:1.0:1789023969.187950:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 23 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.187963:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023969.187970:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+23:3643:x1875927422262272:12345-0@lo:103: 00010000:00010000:1.0:1789023969.187983:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.187988:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.187998:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188014:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb356a expref: 23 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188026:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.188083:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+22:3643:x1875927422262272:12345-0@lo:103: Request processed in 99us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.188091:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023969.188107:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023969.188113:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+21:3643:x1875927422262784:12345-0@lo:103: 00010000:00010000:1.0:1789023969.188127:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.188132:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 21 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188140:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 21 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188169:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1000/0xa736ef4b98cb34ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb34e5 expref: 21 pid: 6510 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188178:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.188201:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+20:3643:x1875927422262784:12345-0@lo:103: Request processed in 89us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.188208:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023969.188221:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023969.188226:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+19:3643:x1875927422262400:12345-0@lo:103: 00010000:00010000:1.0:1789023969.188234:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.188239:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 19 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188247:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 19 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188256:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb3563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb355c expref: 19 pid: 6508 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188265:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.188285:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+18:3643:x1875927422262400:12345-0@lo:103: Request processed in 59us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.188299:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023969.188311:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789023969.188317:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+17:3641:x1875927422262528:12345-0@lo:103: 00010000:00010000:1.0:1789023969.188324:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.188329:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 17 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188349:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 17 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188359:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb3555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb354e expref: 17 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.188368:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.188395:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+16:3641:x1875927422262528:12345-0@lo:103: Request processed in 78us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.188401:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789023969.188514:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422262528:0@lo:103: 00000100:00100000:1.0:1789023969.189120:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262656 00000100:00100000:1.0:1789023969.189127:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262656 00010000:00010000:1.0:1789023969.189172:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 16 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023969.189197:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023969.189204:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+16:3642:x1875927422262656:12345-0@lo:103: 00010000:00010000:1.0:1789023969.189212:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023969.189216:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 16 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.189230:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 16 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.189242:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb350f expref: 16 pid: 6509 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023969.189251:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023969.189288:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f195850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+15:3642:x1875927422262656:12345-0@lo:103: Request processed in 84us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023969.189294:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023969.189365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422262656:0@lo:103: 00000100:00100000:0.0:1789023969.189716:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262400:0@lo:103: 00000100:00100000:0.0:1789023969.189726:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262272:0@lo:103: 00000100:00100000:0.0:1789023969.189733:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422262784:0@lo:103: 00010000:00010000:2.0:1789023969.189850:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023969.207271:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260352:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789023969.207286:0:10331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10331:1875927422260480:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789023969.207333:0:10331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023969.212937:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023969.213027:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023969.216876:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287744 00000100:00100000:2.0:1789023969.216893:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287744 00010000:00010000:2.0:1789023969.216946:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 10 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023969.217059:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402287872 00000100:00100000:2.0:1789023969.217063:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402287872 00010000:00010000:2.0:1789023969.217090:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 11 pid: 6509 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023969.217122:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:2.0:1789023969.217132:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14ec32b5-f959-4605-b464-02aeac6020b2+11:2403:x1875927402287744:12345-192.168.202.18@tcp:103: 00010000:00010000:2.0:1789023969.217164:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023969.217170:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 11 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217182:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 11 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217200:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb3612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af320 expref: 11 pid: 6510 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217216:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023969.217281:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2403:x1875927402287744:12345-192.168.202.18@tcp:103: Request processed in 150us (4355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023969.217289:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:2.0:1789023969.217307:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:2.0:1789023969.217313:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14ec32b5-f959-4605-b464-02aeac6020b2+9:2403:x1875927402287872:12345-192.168.202.18@tcp:103: 00010000:00010000:2.0:1789023969.217469:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023969.217476:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217486:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217610:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb360b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af319 expref: 9 pid: 6509 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217624:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217632:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217651:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217658:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217666:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217672:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217679:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789023969.217685:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.217704:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.225836:0:10331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023969.225868:0:10331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.227634:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.227654:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb3651 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023969.227679:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023969.227817:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14ec32b5-f959-4605-b464-02aeac6020b2+8:2403:x1875927402287872:12345-192.168.202.18@tcp:103: Request processed in 10497us (14784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023969.227828:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:2.0:1789023969.677728:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023969.677756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422262912:0@lo:41: 00000100:00100000:2.0:1789023969.677832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023969.678025:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422262912 00000100:00100000:0.0:1789023969.678033:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422262912 00000100:00100000:0.0:1789023969.678090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789023969.678099:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422262912:12345-0@lo:41: 00000004:00000024:0.0:1789023969.678131:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789023969.678206:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422262912:12345-0@lo:41: Request processed in 108us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023969.678213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789023969.678295:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422262912:0@lo:41: 00010000:00010000:0.0:1789023970.124537:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023970.324339:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023970.324427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023970.324456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023970.324505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023970.324538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023970.324595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288256 00000100:00100000:1.0:1789023970.324609:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288256 00000100:00100000:0.0:1789023970.324671:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288512 00000100:00100000:0.0:1789023970.324676:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288512 00000100:00100000:0.0:1789023970.324741:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288384 00000100:00100000:0.0:1789023970.324744:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288384 00000100:00100000:0.0:1789023970.324774:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:0.0:1789023970.324790:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288512:12345-192.168.202.18@tcp:400: 00000100:00100000:1.0:1789023970.324896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288128 00000100:00100000:0.0:1789023970.324896:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288512:12345-192.168.202.18@tcp:400: Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023970.324900:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288128 00000100:00100000:0.0:1789023970.324905:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789023970.324925:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:0.0:1789023970.324925:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:0.0:1789023970.324932:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288384:12345-192.168.202.18@tcp:400: 00000100:00100000:1.0:1789023970.324933:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288256:12345-192.168.202.18@tcp:400: 00000100:00100000:3.0:1789023970.324974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:3.0:1789023970.324983:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402288128:12345-192.168.202.18@tcp:400: 00000100:00100000:0.0:1789023970.325030:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288384:12345-192.168.202.18@tcp:400: Request processed in 97us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023970.325031:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402288256:12345-192.168.202.18@tcp:400: Request processed in 100us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023970.325038:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:0.0:1789023970.325038:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00080000:1.0:1789023970.325069:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023970.325075:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023970.325077:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023970.325079:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789023970.325704:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402288128:12345-192.168.202.18@tcp:400: Request processed in 719us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023970.325712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:2.0:1789023970.328013:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288000 00000100:00100000:2.0:1789023970.328034:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288000 00000100:00100000:2.0:1789023970.328128:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:2.0:1789023970.328140:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+8:2401:x1875927402288000:12345-192.168.202.18@tcp:400: 00000100:00100000:2.0:1789023970.328322:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+8:2401:x1875927402288000:12345-192.168.202.18@tcp:400: Request processed in 185us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023970.328331:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:2.0:1789023970.700469:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023970.700499:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422263040:0@lo:13: 00000100:00100000:2.0:1789023970.700570:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023970.700756:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023970.700764:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422263168:0@lo:13: 00000100:00100000:0.0:1789023970.700789:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023970.700823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263040 00000100:00100000:0.0:1789023970.700831:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263040 00000100:00100000:0.0:1789023970.700877:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263168 00000100:00100000:0.0:1789023970.700880:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263168 00000100:00100000:0.0:1789023970.700897:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023970.700904:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422263040:12345-0@lo:13: 00002000:00000024:0.0:1789023970.700929:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023970.700968:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422263040:12345-0@lo:13: Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023970.700975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023970.700993:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789023970.700999:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422263168:12345-0@lo:13: 00002000:00000024:0.0:1789023970.701008:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023970.701036:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422263168:12345-0@lo:13: Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023970.701042:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789023970.701068:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023970.701095:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038ab800 x1875927422263168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023970.701114:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422263168:0@lo:13: 00010000:00080000:2.0:1789023970.701206:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90df80 x1875927422263040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023970.701219:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422263040:0@lo:13: 00000100:00100000:0.0:1789023971.092763:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023971.092893:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288640 00000100:00100000:3.0:1789023971.092904:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288640 00000100:00100000:3.0:1789023971.092957:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 200 00000100:00100000:3.0:1789023971.093039:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+8:6174:x1875927402288640:12345-192.168.202.18@tcp:101: 00010000:00010000:3.0:1789023971.093066:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023971.093307:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb3658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af390 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.093337:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af390 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.093348:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af390 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.093357:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030600, rc 0) 00000100:00100000:3.0:1789023971.093463:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402288640:12345-192.168.202.18@tcp:101: Request processed in 426us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.093480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 200 00000100:00100000:3.0:1789023971.107199:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023971.107445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288768 00000100:00100000:0.0:1789023971.107456:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288768 00000100:00100000:0.0:1789023971.107517:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:0.0:1789023971.107528:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402288768:12345-192.168.202.18@tcp:501: 00000100:00100000:0.0:1789023971.107929:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402288768:12345-192.168.202.18@tcp:501: Request processed in 402us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.107938:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:1.0:1789023971.122370:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023971.126610:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402288896 00000100:00100000:2.0:1789023971.126625:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402288896 00000100:00100000:2.0:1789023971.126799:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00100000:2.0:1789023971.126810:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402288896:12345-192.168.202.18@tcp:503: 00000100:00100000:2.0:1789023971.126974:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402288896:12345-192.168.202.18@tcp:503: Request processed in 165us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.126982:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00100000:1.0:1789023971.134499:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023971.135023:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289024 00000100:00100000:3.0:1789023971.135034:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289024 00000100:00100000:3.0:1789023971.135102:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 203 00000100:00100000:3.0:1789023971.135112:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6654:x1875927402289024:12345-192.168.202.18@tcp:502: 00000100:00100000:3.0:1789023971.135651:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+9:6654:x1875927402289024:12345-192.168.202.18@tcp:502: Request processed in 539us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.135660:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 203 00000100:00100000:0.0:1789023971.147365:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023971.147644:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289152 00000100:00100000:3.0:1789023971.147654:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289152 00000100:00100000:3.0:1789023971.147732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 204 00000100:00100000:3.0:1789023971.147743:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6654:x1875927402289152:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023971.147933:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6654:x1875927402289152:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 191us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.147942:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 204 10000000:01000000:2.0:1789023971.148370:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023971.148375:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cb021fb800 from 48 10000000:01000000:2.0:1789023971.148379:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023971.148427:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.148440:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.148450:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023971.148479:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263296:0@lo:101: 00000100:00100000:2.0:1789023971.148520:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.148580:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.148688:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263296 00000100:00100000:1.0:1789023971.148711:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263296 00000100:00100000:1.0:1789023971.148748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789023971.148756:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+15:6512:x1875927422263296:12345-0@lo:101: 00010000:00010000:1.0:1789023971.148767:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023971.148780:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb365f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.148802:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb365f expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.148813:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb365f expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.148822:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160a00, rc 0) 00000100:00100000:1.0:1789023971.148869:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263296:12345-0@lo:101: Request processed in 114us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.148875:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789023971.149518:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263296:0@lo:101: 00010000:00010000:2.0:1789023971.149544:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.149566:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023971.149629:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263424:0@lo:501: 00000100:00100000:2.0:1789023971.149661:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.149693:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.149839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263424 00000100:00100000:1.0:1789023971.149846:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263424 00000100:00100000:1.0:1789023971.149878:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789023971.149886:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263424:12345-0@lo:501: 00010000:00010000:2.0:1789023971.150420:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023971.158216:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263424:12345-0@lo:501: Request processed in 8319us (8543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.158231:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789023971.158454:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263424:0@lo:501: 00000100:00100000:2.0:1789023971.158521:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263552:0@lo:503: 00000100:00100000:2.0:1789023971.158593:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.158622:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.161227:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263552 00000100:00100000:0.0:1789023971.161243:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263552 00000100:00100000:0.0:1789023971.161310:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789023971.161320:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263552:12345-0@lo:503: 00000100:00100000:0.0:1789023971.161488:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263552:12345-0@lo:503: Request processed in 170us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.161495:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789023971.161517:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023971.161606:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263552:0@lo:503: 00000100:00100000:3.0:1789023971.161879:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10348:1875927422263680:0@lo:502: 00000100:00100000:3.0:1789023971.161919:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.162773:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289280 00000100:00100000:0.0:1789023971.162781:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289280 00000100:00100000:0.0:1789023971.162816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 208 00000100:00100000:0.0:1789023971.162824:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402289280:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023971.162836:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023971.162973:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb366d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af397 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.163004:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af397 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.163015:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af397 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.163023:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489800, rc 0) 00000100:00100000:0.0:1789023971.163165:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289280:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 323us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.163181:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 208 00000100:00100000:3.0:1789023971.175389:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.175872:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263680 00000100:00100000:2.0:1789023971.175882:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263680 00000100:00100000:2.0:1789023971.175989:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789023971.176011:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:10348:x1875927422263680:12345-0@lo:502: 00000100:00100000:2.0:1789023971.177497:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+16:10348:x1875927422263680:12345-0@lo:502: Request processed in 1495us (15572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.177508:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789023971.178637:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10348:1875927422263680:0@lo:502: 00000100:00100000:3.0:1789023971.178827:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10348:1875927422263808:0@lo:502: 00000100:00100000:3.0:1789023971.178886:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.179845:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023971.187207:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.190630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263808 00000100:00100000:1.0:1789023971.190647:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263808 00000100:00100000:1.0:1789023971.190705:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289408 00000100:00100000:1.0:1789023971.190708:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289408 00000100:00100000:1.0:1789023971.190744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789023971.190754:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:10348:x1875927422263808:12345-0@lo:502: 00000100:00100000:1.0:1789023971.190940:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:10348:x1875927422263808:12345-0@lo:502: Request processed in 188us (12054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.190948:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789023971.190985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:1.0:1789023971.190992:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289408:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.191247:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10348:1875927422263808:0@lo:502: 00000040:00080000:0.0:1789023971.191285:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789023971.191435:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789023971.191457:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023971.191466:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.191476:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023971.191487:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789023971.191489:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789023971.191492:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789023971.191521:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.191530:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.191538:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023971.191556:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263936:0@lo:101: 00000100:00100000:0.0:1789023971.191592:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.191615:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02f150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.191665:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289408:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 672us (11824us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789023971.191673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:1.0:1789023971.191883:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422263936 00000100:00100000:1.0:1789023971.191887:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422263936 00000100:00100000:1.0:1789023971.191905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789023971.191910:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+16:6512:x1875927422263936:12345-0@lo:101: 00010000:00010000:1.0:1789023971.191919:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023971.191929:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb367b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3674 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.191951:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3674 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.191962:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3674 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.191971:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160800, rc 0) 00000100:00100000:1.0:1789023971.192431:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422263936:12345-0@lo:101: Request processed in 519us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.192450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789023971.201022:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422263936:0@lo:101: 00010000:00010000:0.0:1789023971.201085:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.201098:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023971.201203:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264064:0@lo:501: 00000100:00100000:0.0:1789023971.201261:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.201297:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02f150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.201539:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264064 00000100:00100000:1.0:1789023971.201546:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264064 00000100:00100000:1.0:1789023971.201596:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789023971.201606:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422264064:12345-0@lo:501: 00000100:00100000:1.0:1789023971.201751:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422264064:12345-0@lo:501: Request processed in 147us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.201759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789023971.201952:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264064:0@lo:501: 00000100:00100000:3.0:1789023971.201997:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264192:0@lo:503: 00000100:00100000:3.0:1789023971.202039:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.202078:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.202181:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264192 00000100:00100000:2.0:1789023971.202186:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264192 00000100:00100000:2.0:1789023971.202208:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789023971.202214:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264192:12345-0@lo:503: 00000100:00100000:2.0:1789023971.202304:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264192:12345-0@lo:503: Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.202311:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789023971.203190:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264192:0@lo:503: 00000100:00100000:3.0:1789023971.205202:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10349:1875927422264320:0@lo:502: 00000100:00100000:3.0:1789023971.205282:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.205332:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.205474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264320 00000100:00100000:2.0:1789023971.205482:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264320 00000100:00100000:2.0:1789023971.205534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789023971.205543:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:10349:x1875927422264320:12345-0@lo:502: 00000100:00100000:2.0:1789023971.205675:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+17:10349:x1875927422264320:12345-0@lo:502: Request processed in 133us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.205683:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789023971.206191:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10349:1875927422264320:0@lo:502: 00000020:01000000:3.0:1789023971.206217:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023971.206231:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023971.206234:0:10349:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789023971.206239:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789023971.206265:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10349:1875927422264448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.206302:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.206340:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.206397:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264448 00000100:00100000:2.0:1789023971.206402:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264448 00000100:00100000:2.0:1789023971.206437:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789023971.206444:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:10349:x1875927422264448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.206520:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:10349:x1875927422264448:12345-0@lo:502:llog_process_th.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.206527:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789023971.206612:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10349:1875927422264448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023971.206630:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023971.206634:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023971.206636:0:10349:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789023971.206639:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789023971.206887:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789023971.206908:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789023971.206918:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.206930:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023971.206940:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023971.206943:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc3bd3a000 from 48 10000000:01000000:2.0:1789023971.206946:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023971.206982:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.206990:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.207005:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023971.207019:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023971.207049:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.207085:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.207297:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264576 00000100:00100000:3.0:1789023971.207302:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264576 00000100:00100000:3.0:1789023971.207331:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789023971.207338:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+17:6512:x1875927422264576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023971.207348:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023971.207360:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb3689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3682 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.207381:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3682 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.207392:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3682 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.207400:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031a00, rc 0) 00000100:00100000:3.0:1789023971.207434:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.207440:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789023971.207586:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023971.207598:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.207607:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023971.207655:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023971.207682:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.207711:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.208308:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264704 00000100:00100000:3.0:1789023971.208314:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264704 00000100:00100000:3.0:1789023971.208350:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789023971.208356:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.208470:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.208477:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789023971.210031:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.210304:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.210379:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.210425:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.210487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264832 00000100:00100000:3.0:1789023971.210493:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264832 00000100:00100000:3.0:1789023971.210540:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789023971.210548:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.210652:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422264832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.210659:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789023971.210747:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422264832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.211780:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10350:1875927422264960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.211836:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.211871:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.213737:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422264960 00000100:00100000:1.0:1789023971.213751:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422264960 00000100:00100000:1.0:1789023971.213825:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789023971.213834:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:10350:x1875927422264960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.215025:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:10350:x1875927422264960:12345-0@lo:502:llog_process_th.0 Request processed in 1187us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.215037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789023971.218884:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422265216:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.218950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.218996:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422265728:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.219026:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.219045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422266240:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.219465:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.219531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789023971.219761:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422265088:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.219798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.219874:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265728 00000100:00100000:1.0:1789023971.219885:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265728 00000100:00100000:3.0:1789023971.219926:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422265600:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.219962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.219972:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266240 00000100:00100000:1.0:1789023971.219978:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266240 00000100:00100000:3.0:1789023971.219984:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422266112:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220007:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265088 00000100:00100000:1.0:1789023971.220023:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265088 00000100:00100000:3.0:1789023971.220029:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.220064:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265600 00000100:00100000:1.0:1789023971.220070:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265600 00000100:00100000:1.0:1789023971.220090:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266112 00000100:00100000:1.0:1789023971.220092:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266112 00000100:00100000:1.0:1789023971.220109:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789023971.220117:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422265728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220198:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422265728:12345-0@lo:400:kworker.0 Request processed in 82us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.220205:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789023971.220222:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789023971.220228:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422266240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220255:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422266240:12345-0@lo:400:kworker.0 Request processed in 27us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.220260:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789023971.220271:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789023971.220276:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422265088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220309:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422265088:12345-0@lo:400:kworker.0 Request processed in 32us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.220314:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789023971.220326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422265344:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220335:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023971.220347:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422265600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.220378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.220408:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422265600:12345-0@lo:400:kworker.0 Request processed in 62us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.220415:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023971.220424:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265344 00000100:00100000:1.0:1789023971.220427:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265344 00000100:00100000:1.0:1789023971.220450:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023971.220455:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422266112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.220470:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422265856:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.220509:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.220536:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422266368:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.220630:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.220660:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789023971.220672:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422265472:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.220694:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422266112:12345-0@lo:400:kworker.0 Request processed in 236us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.220701:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023971.220721:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789023971.220731:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422265344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.220740:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.220774:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422265984:0@lo:400:kworker.0 00000100:00080000:0.0:1789023971.220925:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023971.220930:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789023971.221550:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265216 00000100:00100000:0.0:1789023971.221556:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265216 00000100:00100000:0.0:1789023971.221595:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265472 00000100:00100000:0.0:1789023971.221598:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265472 00000100:00100000:0.0:1789023971.221615:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023971.221621:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.221788:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422265344:12345-0@lo:400:kworker.0 Request processed in 1059us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.221796:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789023971.224378:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422266752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789023971.224452:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.226165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422265088:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.226184:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422265600:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.226195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422266112:0@lo:400:kworker.0 00010000:00080000:1.0:1789023971.226207:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90c000 x1875927422265728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023971.226217:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422265728:0@lo:400:kworker.0 00010000:00080000:1.0:1789023971.226228:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974e00 x1875927422266240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023971.226235:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422266240:0@lo:400:kworker.0 00000100:00100000:1.0:1789023971.226267:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023971.226276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422266624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023971.226341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.226693:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266752 00000100:00100000:3.0:1789023971.226709:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266752 00000100:00100000:3.0:1789023971.226793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266624 00000100:00100000:3.0:1789023971.226797:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266624 00000100:00100000:3.0:1789023971.226823:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023971.227397:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422266752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789023971.227457:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789023971.227533:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789023971.227580:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038abb80 x1875927422266752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023971.227602:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422266752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789023971.227676:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422266752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 840us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.227685:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023971.227709:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023971.227717:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422266624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023971.227745:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023971.227794:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422266624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.227801:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023971.227919:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265856 00000100:00100000:3.0:1789023971.227926:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265856 00000100:00100000:3.0:1789023971.227957:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266368 00000100:00100000:3.0:1789023971.227960:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266368 00000100:00100000:3.0:1789023971.227986:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023971.227992:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422265856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228045:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422265856:12345-0@lo:400:kworker.0 Request processed in 53us (7535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.228062:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023971.228074:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023971.228081:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422266368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228213:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422266368:12345-0@lo:400:kworker.0 Request processed in 132us (7582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.228220:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023971.228249:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789023971.228259:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422265472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228297:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422265472:12345-0@lo:400:kworker.0 Request processed in 41us (7564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.228302:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789023971.228635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.228681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422266496:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228715:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.228747:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422265984 00000100:00100000:3.0:1789023971.228752:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422265984 00000100:00100000:3.0:1789023971.228774:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266496 00000100:00100000:3.0:1789023971.228778:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266496 00000100:00100000:3.0:1789023971.228791:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023971.228797:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422265984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228829:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422265984:12345-0@lo:400:kworker.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.228915:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023971.228931:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023971.228938:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422266496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.228969:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422266496:12345-0@lo:400:kworker.0 Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.228974:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789023971.229011:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f975f80 x1875927422266496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789023971.229218:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a9f80 x1875927422266624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023971.229241:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422266624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023971.229470:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422266496:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.229491:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422265344:0@lo:400:kworker.0 00010000:00080000:3.0:1789023971.229504:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90e300 x1875927422265856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023971.229512:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422265856:0@lo:400:kworker.0 00010000:00080000:3.0:1789023971.229524:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f975c00 x1875927422266368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023971.229533:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422266368:0@lo:400:kworker.0 00000100:00100000:2.0:1789023971.229644:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10350:1875927422264960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.229649:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422265472:0@lo:400:kworker.0 00010000:00080000:3.0:1789023971.229681:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90f800 x1875927422265984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023971.229691:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422265984:0@lo:400:kworker.0 00000100:00100000:2.0:1789023971.229739:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10350:1875927422266880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.229824:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.229873:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.230953:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422266880 00000100:00100000:3.0:1789023971.230966:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422266880 00000100:00100000:3.0:1789023971.231038:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789023971.231049:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:10350:x1875927422266880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.231446:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+18:10350:x1875927422266880:12345-0@lo:502:llog_process_th.0 Request processed in 399us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.231453:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789023971.233938:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10350:1875927422266880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789023971.233990:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789023971.234523:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789023971.234550:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023971.234562:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.234575:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023971.234585:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789023971.234588:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789023971.234591:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789023971.234627:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.234635:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.234644:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.234682:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.234745:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.234797:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.235218:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422265216:12345-0@lo:400:kworker.0 Request processed in 13594us (16264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.235229:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789023971.236095:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422265216:0@lo:400:kworker.0 00000100:00100000:3.0:1789023971.238283:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267008 00000100:00100000:3.0:1789023971.238322:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267008 00000100:00100000:3.0:1789023971.238419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789023971.238436:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+18:6512:x1875927422267008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023971.238478:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023971.238506:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030c00/0xa736ef4b98cb3697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3690 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.238555:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030c00/0xa736ef4b98cb3697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3690 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.238568:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030c00/0xa736ef4b98cb3697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3690 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.238579:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030c00, rc 0) 00000100:00100000:3.0:1789023971.238689:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (3943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.238720:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789023971.238773:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023971.238803:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.238817:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.238907:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.238962:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.239006:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.239331:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267136 00000100:00100000:2.0:1789023971.239338:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267136 00000100:00100000:2.0:1789023971.239389:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789023971.239397:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023971.239538:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.239546:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789023971.240600:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.240693:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.240791:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.240838:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.240910:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267264 00000100:00100000:1.0:1789023971.240921:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267264 00000100:00100000:1.0:1789023971.240976:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789023971.240985:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.241181:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.241189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789023971.242247:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.243808:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10352:1875927422267392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.243905:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.243962:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.244067:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267392 00000100:00100000:3.0:1789023971.244075:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267392 00000100:00100000:3.0:1789023971.244184:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789023971.244194:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+19:10352:x1875927422267392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.244333:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+19:10352:x1875927422267392:12345-0@lo:502:llog_process_th.0 Request processed in 142us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.244343:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789023971.244394:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10352:1875927422267392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023971.244478:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023971.244493:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023971.244495:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789023971.244500:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789023971.244560:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10352:1875927422267520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.244622:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.257800:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02f15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.258565:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267520 00000100:00100000:1.0:1789023971.258582:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267520 00000100:00100000:1.0:1789023971.258654:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789023971.258666:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:10352:x1875927422267520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.259163:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:10352:x1875927422267520:12345-0@lo:502:llog_process_th.0 Request processed in 481us (14523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.259172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789023971.259635:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10352:1875927422267520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023971.259693:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023971.259705:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023971.259708:0:10352:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789023971.259713:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789023971.259924:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789023971.259959:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789023971.259970:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.259984:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023971.259994:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789023971.259997:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc414b7800 from 48 10000000:01000000:3.0:1789023971.260000:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789023971.260036:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.260069:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.260081:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023971.260105:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.260169:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.260212:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203000 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.260263:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267648 00000100:00100000:1.0:1789023971.260269:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267648 00000100:00100000:1.0:1789023971.260299:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789023971.260305:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+19:6512:x1875927422267648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023971.260314:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023971.260323:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161800/0xa736ef4b98cb36a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb369e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.260339:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161800/0xa736ef4b98cb36a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb369e expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.260347:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161800/0xa736ef4b98cb36a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb369e expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.260352:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161800, rc 0) 00000100:00100000:1.0:1789023971.260380:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422267648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.260384:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789023971.260412:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023971.260422:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.260436:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.260479:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.260498:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.260516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267776 00000100:00100000:1.0:1789023971.260518:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267776 00000100:00100000:1.0:1789023971.260535:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789023971.260540:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422267776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.260632:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422267776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.260640:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789023971.260665:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.260678:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.260702:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.260752:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.260784:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.260810:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422267904 00000100:00100000:0.0:1789023971.261099:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422267904 00000100:00100000:0.0:1789023971.261202:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789023971.261211:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422267904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.261620:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422267904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 409us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.261629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789023971.263283:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422267904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.263940:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10353:1875927422268032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.264014:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.264071:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.264128:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268032 00000100:00100000:2.0:1789023971.264134:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268032 00000100:00100000:2.0:1789023971.264202:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789023971.264214:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:10353:x1875927422268032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.264346:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:10353:x1875927422268032:12345-0@lo:502:llog_process_th.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.264354:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789023971.264590:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10353:1875927422268032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.264623:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10353:1875927422268160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.264646:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023971.264670:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789023971.264718:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268160 00000100:00100000:1.0:1789023971.264723:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268160 00000100:00100000:1.0:1789023971.264752:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789023971.264759:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:10353:x1875927422268160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.264913:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:10353:x1875927422268160:12345-0@lo:502:llog_process_th.0 Request processed in 155us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.264928:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789023971.265008:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10353:1875927422268160:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789023971.265026:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789023971.265303:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789023971.265324:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023971.265334:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.265344:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023971.265354:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789023971.265357:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1789023971.265360:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789023971.265383:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.265391:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.265399:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.265409:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.265431:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.267590:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.267719:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268288 00000100:00100000:2.0:1789023971.267730:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268288 00000100:00100000:2.0:1789023971.267840:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789023971.267850:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422268288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023971.267865:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023971.267883:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb36b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36ac expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.267909:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36ac expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.267919:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36ac expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.267929:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0200, rc 0) 00000100:00100000:2.0:1789023971.268060:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023971.268069:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023971.268078:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00010000:1.0:1789023971.268085:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.268102:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.268280:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.268310:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.273329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268416 00000100:00100000:0.0:1789023971.273343:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268416 00000100:00100000:1.0:1789023971.273366:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.273395:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789023971.273404:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.273649:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (5337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.273657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789023971.273875:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.273920:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.273967:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.273989:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.274028:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268544 00000100:00100000:3.0:1789023971.274033:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268544 00000100:00100000:3.0:1789023971.274077:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789023971.274085:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.274604:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 519us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.274621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789023971.274709:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.275101:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10354:1875927422268672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.275140:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.275270:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.276298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268672 00000100:00100000:0.0:1789023971.276308:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268672 00000100:00100000:0.0:1789023971.276355:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789023971.276365:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:10354:x1875927422268672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.278587:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:10354:x1875927422268672:12345-0@lo:502:llog_process_th.0 Request processed in 2215us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.278601:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789023971.278951:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10354:1875927422268672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789023971.278999:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023971.279008:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023971.279010:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789023971.279018:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789023971.279067:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10354:1875927422268800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.279128:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.279302:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.279617:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268800 00000100:00100000:2.0:1789023971.279624:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268800 00000100:00100000:2.0:1789023971.279711:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789023971.279722:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:10354:x1875927422268800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.279870:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:10354:x1875927422268800:12345-0@lo:502:llog_process_th.0 Request processed in 150us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.279878:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789023971.279943:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10354:1875927422268800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789023971.279967:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023971.279972:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023971.279974:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789023971.279978:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789023971.280068:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789023971.280093:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789023971.280101:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.280112:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023971.280123:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789023971.280127:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc199e6000 from 48 10000000:01000000:0.0:1789023971.280131:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023971.280211:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.280220:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.280229:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023971.280245:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.280273:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.280605:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.280952:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422268928 00000100:00100000:3.0:1789023971.280959:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422268928 00000100:00100000:3.0:1789023971.280992:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789023971.280999:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422268928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023971.281011:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023971.281024:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb36c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36ba expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.281047:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb36c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36ba expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.281069:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb36c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36ba expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023971.281077:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031200, rc 0) 00000100:00100000:3.0:1789023971.281129:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422268928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.281135:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789023971.281409:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422268928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023971.281424:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.281433:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023971.281497:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.281548:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.281574:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.281582:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269056 00000100:00100000:3.0:1789023971.281586:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269056 00000100:00100000:3.0:1789023971.281615:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789023971.281621:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422269056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.281734:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422269056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.281741:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789023971.281841:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.281868:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.281906:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.281922:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.281942:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269184 00000100:00100000:3.0:1789023971.281954:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269184 00000100:00100000:3.0:1789023971.282012:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789023971.282019:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422269184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.282113:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422269184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.282119:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789023971.282201:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.282598:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10355:1875927422269312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.282632:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.282745:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.282809:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269312 00000100:00100000:2.0:1789023971.282814:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269312 00000100:00100000:2.0:1789023971.282836:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789023971.282843:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10355:x1875927422269312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.282936:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10355:x1875927422269312:12345-0@lo:502:llog_process_th.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.282944:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789023971.283065:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10355:1875927422269312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.283102:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10355:1875927422269440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.283133:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.283177:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.283223:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269440 00000100:00100000:2.0:1789023971.283227:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269440 00000100:00100000:2.0:1789023971.283244:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789023971.283250:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10355:x1875927422269440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.283387:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10355:x1875927422269440:12345-0@lo:502:llog_process_th.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.283392:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789023971.283610:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10355:1875927422269440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789023971.283629:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789023971.283833:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789023971.283855:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023971.283864:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.283874:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023971.283885:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789023971.283888:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789023971.283891:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789023971.283916:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.283924:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.283933:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.283948:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.283977:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.284038:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.284075:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269568 00000100:00100000:2.0:1789023971.284080:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269568 00000100:00100000:2.0:1789023971.284172:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789023971.284181:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422269568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023971.284198:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023971.284210:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb36cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36c8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.284230:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb36cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36c8 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.284240:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb36cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36c8 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.284248:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0800, rc 0) 00000100:00100000:2.0:1789023971.284404:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422269568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.284409:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789023971.284611:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023971.284625:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.284640:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.284693:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.284718:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.284750:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.284839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269696 00000100:00100000:3.0:1789023971.284843:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269696 00000100:00100000:3.0:1789023971.284910:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789023971.284918:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422269696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.285030:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422269696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.285037:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789023971.285106:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.285131:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.285197:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.285213:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043180 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.285389:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269824 00000100:00100000:3.0:1789023971.285394:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269824 00000100:00100000:3.0:1789023971.285411:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789023971.285417:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422269824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023971.285499:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422269824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.285506:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789023971.285569:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422269824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.286228:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10356:1875927422269952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023971.286269:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.286295:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043300 going to sleep for 11 seconds 00000100:00100000:3.0:1789023971.286368:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422269952 00000100:00100000:3.0:1789023971.286374:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422269952 00000100:00100000:3.0:1789023971.286402:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789023971.286409:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:10356:x1875927422269952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023971.286655:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:10356:x1875927422269952:12345-0@lo:502:llog_process_th.0 Request processed in 246us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023971.286672:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789023971.286869:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10356:1875927422269952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023971.286957:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023971.286967:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023971.286969:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789023971.286975:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789023971.287000:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10356:1875927422270080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023971.287032:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023971.287100:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023971.287136:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270080 00000100:00100000:0.0:1789023971.287141:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270080 00000100:00100000:0.0:1789023971.287449:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789023971.287458:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:10356:x1875927422270080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023971.287591:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:10356:x1875927422270080:12345-0@lo:502:llog_process_th.0 Request processed in 134us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023971.287599:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789023971.287675:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10356:1875927422270080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023971.287696:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023971.287701:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023971.287703:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789023971.287707:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789023971.287944:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789023971.287963:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789023971.287973:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.287984:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023971.287995:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789023971.288003:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cc339999c0 from 1 10000000:01000000:1.0:1789023971.288006:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789023971.288031:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.288038:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023971.288046:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023971.288071:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422270208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023971.288101:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023971.288192:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.288442:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270208 00000100:00100000:2.0:1789023971.288448:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270208 00000100:00100000:2.0:1789023971.288486:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789023971.288502:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422270208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023971.288513:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023971.288525:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0600/0xa736ef4b98cb36dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36d6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.288547:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0600/0xa736ef4b98cb36dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36d6 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.288556:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0600/0xa736ef4b98cb36dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36d6 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023971.288564:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0600, rc 0) 00000100:00100000:2.0:1789023971.288606:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422270208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023971.288613:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789023971.288679:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422270208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023971.288693:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.288702:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023971.288754:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422270336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023971.288791:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023971.288822:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023971.288920:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270336 00000100:00100000:2.0:1789023971.288924:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270336 00000100:00100000:2.0:1789023971.288956:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789023971.288963:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422270336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023971.289028:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422270336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (236us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023971.289035:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789023971.289101:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422270336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789023971.289124:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789023971.289129:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023971.289136:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.174876:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789023972.515886:0:10393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe906b0a20 20000000:00000080:2.0:1789023972.515904:0:10393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb03914c00 uarg=0000000000000000 20000000:01000000:2.0:1789023972.515947:0:10393:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789023972.515954:0:10393:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789023972.515958:0:10393:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789023972.522593:0:10394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789023972.522930:0:10393:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789023972.525892:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789023972.525930:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789023972.525947:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789023972.525964:0:10393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789023972.525984:0:10393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.526003:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.526011:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.526018:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.526024:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.526034:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.534753:0:10393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.534818:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.534833:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 9 pid: 6509 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.534849:0:10393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270464:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789023972.534991:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.535001:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 23 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.535010:0:10393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270592:0@lo:104: 00000100:00100000:2.0:1789023972.535070:0:10393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023972.535105:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.535114:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 23 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.535122:0:10393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270720:0@lo:104: 00000100:00100000:2.0:1789023972.535167:0:10393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023972.535189:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.535197:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 23 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.535205:0:10393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270848:0@lo:104: 00010000:00010000:2.0:1789023972.535229:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.535236:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 23 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.535244:0:10393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270976:0@lo:104: 00000100:00100000:2.0:1789023972.535267:0:10393:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023972.535351:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789023972.535370:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.535382:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.535402:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270592 00000100:00100000:3.0:1789023972.535409:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270592 00000100:00100000:3.0:1789023972.535445:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270720 00000100:00100000:3.0:1789023972.535448:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270720 00000100:00100000:3.0:1789023972.535456:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270848 00000100:00100000:3.0:1789023972.535459:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270848 00000100:00100000:3.0:1789023972.535467:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422270976 00000100:00100000:3.0:1789023972.535469:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422270976 00000100:00100000:3.0:1789023972.535479:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789023972.535487:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:10393:x1875927422270592:12345-0@lo:104: 00010000:00010000:3.0:1789023972.535500:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535564:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023972.535570:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+6:10393:x1875927422270592:12345-0@lo:104: Request processed in 84us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.535576:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789023972.535592:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789023972.535598:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f959050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10393:x1875927422270720:12345-0@lo:104: 00010000:00010000:3.0:1789023972.535605:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535637:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789023972.535643:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f959050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+5:10393:x1875927422270720:12345-0@lo:104: Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.535654:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789023972.535685:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023972.535692:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10393:x1875927422270848:12345-0@lo:104: 00010000:00010000:3.0:1789023972.535700:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535732:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789023972.535738:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+4:10393:x1875927422270848:12345-0@lo:104: Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.535744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023972.535756:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789023972.535762:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10393:x1875927422270976:12345-0@lo:104: 00010000:00010000:3.0:1789023972.535769:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535798:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789023972.535802:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:10393:x1875927422270976:12345-0@lo:104: Request processed in 41us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.535808:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789023972.535823:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789023972.535830:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535837:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023972.535840:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535859:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023972.535866:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023972.535872:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023972.535897:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535902:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023972.535925:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535931:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4000/0xa736ef4b98cb3501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3508 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535944:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789023972.535947:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535953:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023972.535955:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535961:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023972.535967:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023972.535978:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023972.535991:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.535997:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023972.536004:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536009:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0400/0xa736ef4b98cb33db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb33e2 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536018:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789023972.536021:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536026:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023972.536029:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536035:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023972.536053:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023972.536058:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023972.536071:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536077:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023972.536099:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536106:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1200/0xa736ef4b98cb3387 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb338e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536113:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023972.536116:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536121:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789023972.536123:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536128:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023972.536133:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023972.536138:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023972.536176:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536182:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023972.536188:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536195:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1a00/0xa736ef4b98cb3379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3380 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536206:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023972.536213:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023972.536215:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023972.536222:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023972.536228:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023972.536233:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023972.536245:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422271104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536286:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.536320:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023972.536326:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422271232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.536373:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422271360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536395:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.536413:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023972.536418:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422271488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.536470:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271104 00000100:00100000:3.0:1789023972.536475:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271104 00010000:00010000:3.0:1789023972.536493:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 24 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.536508:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271232 00000100:00100000:3.0:1789023972.536510:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271232 00010000:00010000:3.0:1789023972.536519:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 25 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.536528:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271360 00000100:00100000:3.0:1789023972.536530:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271360 00010000:00010000:3.0:1789023972.536539:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 26 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.536561:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271488 00000100:00100000:3.0:1789023972.536563:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271488 00010000:00010000:3.0:1789023972.536573:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 27 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.536584:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023972.536590:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+27:3641:x1875927422271104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023972.536600:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023972.536605:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 27 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536614:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 27 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536627:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023972.536657:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+27:3641:x1875927422271104:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.536663:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023972.536676:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789023972.536682:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+26:3641:x1875927422271232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023972.536689:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023972.536694:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 26 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536702:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 26 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536710:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023972.536736:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+26:3641:x1875927422271232:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.536742:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789023972.536754:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789023972.536760:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422271360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023972.536767:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023972.536771:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 25 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536780:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 25 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536789:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023972.536815:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422271360:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.536821:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789023972.536831:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789023972.536837:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422271488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023972.536844:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023972.536848:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 24 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536855:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 24 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.536863:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023972.536884:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f196450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422271488:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.536889:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789023972.536955:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422271488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536964:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422271360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536985:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422271232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023972.536991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422271104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023972.537529:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb3508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3501 expref: 23 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.537544:0:10393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270592:0@lo:104: 00010000:00010000:2.0:1789023972.537554:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0c00/0xa736ef4b98cb33e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb33db expref: 22 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.537561:0:10393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270720:0@lo:104: 00010000:00010000:2.0:1789023972.537570:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb338e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3387 expref: 21 pid: 6508 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.537579:0:10393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270848:0@lo:104: 00010000:00010000:2.0:1789023972.537588:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb3380 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3379 expref: 20 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023972.537596:0:10393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270976:0@lo:104: 00000100:00100000:2.0:1789023972.539060:0:10393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875927422270464:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789023972.539108:0:10393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023972.541766:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023972.541976:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289536 00000100:00100000:3.0:1789023972.541986:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289536 00010000:00010000:3.0:1789023972.542025:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.542082:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:3.0:1789023972.542092:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+10:2403:x1875927402289536:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023972.542107:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023972.542113:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542125:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542143:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af358 expref: 10 pid: 6509 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542194:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542203:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542220:0:7924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542239:0:7924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542246:0:7924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542254:0:7924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542261:0:7924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789023972.542265:0:7924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542274:0:7924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542291:0:7924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.542301:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023972.542348:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+9:2403:x1875927402289536:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 258us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.542355:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 39 00010000:00010000:2.0:1789023972.542432:0:10393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.542441:0:10393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023972.542447:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0a00/0xa736ef4b98cb36e4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023972.629244:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023972.629252:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb021fb800 from 4 10000000:01000000:0.0:1789023972.629257:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023972.629301:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.629313:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.629325:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.629360:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.629439:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.629495:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023972.629547:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271616 00000100:00100000:3.0:1789023972.629555:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271616 00000100:00100000:3.0:1789023972.629607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789023972.629617:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422271616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023972.629629:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023972.629642:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.629671:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.629683:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023972.629693:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789023972.629733:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422271616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.629740:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789023972.631103:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.631124:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.631135:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.631232:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.631275:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.631309:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023972.631432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271744 00000100:00100000:3.0:1789023972.631438:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271744 00000100:00100000:3.0:1789023972.631478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789023972.631486:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422271744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023972.631607:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422271744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.631615:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789023972.632070:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.632102:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.632182:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.632210:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023972.632335:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422271872 00000100:00100000:3.0:1789023972.632340:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422271872 00000100:00100000:3.0:1789023972.632373:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789023972.632381:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422271872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023972.632476:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422271872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.632483:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789023972.632779:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422271872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.636562:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10398:1875927422272000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.636649:0:10398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.636697:0:10398:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023972.638266:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272000 00000100:00100000:3.0:1789023972.638278:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272000 00000100:00100000:3.0:1789023972.638347:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789023972.638357:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:10398:x1875927422272000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023972.638539:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:10398:x1875927422272000:12345-0@lo:502:llog_process_th.0 Request processed in 184us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.638548:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789023972.638779:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10398:1875927422272000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023972.638818:0:10398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023972.638830:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023972.638833:0:10398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789023972.638840:0:10398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb021fb800 00000020:00000080:2.0:1789023972.638843:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789023972.640580:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10398:1875927422272128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023972.640651:0:10398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023972.640687:0:10398:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.640978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272128 00000100:00100000:0.0:1789023972.640986:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272128 00000100:00100000:0.0:1789023972.641051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789023972.641068:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:10398:x1875927422272128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.641223:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:10398:x1875927422272128:12345-0@lo:502:llog_process_th.0 Request processed in 157us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.641231:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789023972.648619:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10398:1875927422272128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023972.648673:0:10398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023972.648683:0:10398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023972.648685:0:10398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789023972.648690:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789023972.648911:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789023972.648932:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023972.648953:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.648965:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023972.648976:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023972.648978:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc3bd3a000 from 4 10000000:01000000:0.0:1789023972.648980:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023972.649014:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649022:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649031:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.649063:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649124:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.649175:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.649190:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272256 00000100:00100000:0.0:1789023972.649196:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272256 00000100:00100000:0.0:1789023972.649243:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789023972.649251:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422272256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.649263:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023972.649275:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb36f9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649296:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649305:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649314:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488600, rc 0) 00000100:00100000:0.0:1789023972.649344:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.649351:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789023972.649385:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.649407:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.649415:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.649459:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649481:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.649495:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.649505:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272384 00000100:00100000:0.0:1789023972.649509:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272384 00000100:00100000:0.0:1789023972.649535:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789023972.649541:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649644:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.649650:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789023972.649678:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649702:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649742:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.649753:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.649764:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272512 00000100:00100000:0.0:1789023972.649767:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272512 00000100:00100000:0.0:1789023972.649786:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789023972.649791:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.649860:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.649879:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789023972.649917:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.654436:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10401:1875927422272640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.654522:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.654560:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272640 00000100:00100000:0.0:1789023972.654566:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272640 00000100:00100000:0.0:1789023972.654605:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789023972.654614:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10401:x1875927422272640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.654734:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:10401:x1875927422272640:12345-0@lo:502:llog_process_th.0 Request processed in 120us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.654747:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789023972.654796:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.654814:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10401:1875927422272640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023972.654841:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023972.654849:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023972.654852:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789023972.654858:0:10401:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc3bd3a000 00000020:00000080:0.0:1789023972.654860:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023972.655336:0:10401:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10401:1875927422272768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.655371:0:10401:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.655393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272768 00000100:00100000:0.0:1789023972.655397:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272768 00000100:00100000:0.0:1789023972.655420:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789023972.655425:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:10401:x1875927422272768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.655487:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:10401:x1875927422272768:12345-0@lo:502:llog_process_th.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.655494:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789023972.655522:0:10401:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.655535:0:10401:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10401:1875927422272768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023972.655553:0:10401:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023972.655557:0:10401:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023972.655559:0:10401:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789023972.655562:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789023972.661499:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789023972.661529:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023972.661541:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661561:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023972.661572:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023972.661575:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc414b7800 from 4 10000000:01000000:0.0:1789023972.661578:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023972.661612:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661620:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661630:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.661657:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.661721:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.661757:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.661776:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422272896 00000100:00100000:0.0:1789023972.661783:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422272896 00000100:00100000:0.0:1789023972.661821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789023972.661830:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422272896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.661842:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023972.661867:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3707 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661889:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661911:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.661921:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f600, rc 0) 00000100:00100000:0.0:1789023972.661955:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422272896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.661962:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789023972.662008:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422272896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.662022:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.662031:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.671214:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.671281:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.671324:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273024 00000100:00100000:0.0:1789023972.671331:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273024 00000100:00100000:0.0:1789023972.671368:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789023972.671376:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422273024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.671487:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422273024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.671495:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789023972.671537:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.671557:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.671594:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.671633:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.671652:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273152 00000100:00100000:0.0:1789023972.671656:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273152 00000100:00100000:0.0:1789023972.671676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789023972.671683:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422273152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.671750:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422273152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.671757:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789023972.671784:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.671794:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.672494:0:10404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10404:1875927422273280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.672526:0:10404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.672543:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273280 00000100:00100000:0.0:1789023972.672546:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273280 00000100:00100000:0.0:1789023972.672562:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789023972.672566:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:10404:x1875927422273280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.672621:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:10404:x1875927422273280:12345-0@lo:502:llog_process_th.0 Request processed in 54us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.672626:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789023972.672649:0:10404:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.672657:0:10404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10404:1875927422273280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023972.672674:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023972.672682:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023972.672687:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789023972.672692:0:10404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc414b7800 00000020:00000080:0.0:1789023972.672694:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023972.673175:0:10404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10404:1875927422273408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.673203:0:10404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.673220:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273408 00000100:00100000:0.0:1789023972.673222:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273408 00000100:00100000:0.0:1789023972.673237:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789023972.673242:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:10404:x1875927422273408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.673287:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:10404:x1875927422273408:12345-0@lo:502:llog_process_th.0 Request processed in 45us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.673292:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789023972.673314:0:10404:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc346169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.673322:0:10404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10404:1875927422273408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023972.673336:0:10404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023972.673341:0:10404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023972.673342:0:10404:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789023972.673346:0:10404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789023972.673524:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789023972.673542:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023972.673551:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673563:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023972.673574:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023972.673577:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc199e6000 from 4 10000000:01000000:0.0:1789023972.673580:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023972.673607:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673614:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673623:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.673636:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.673662:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.673677:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc346169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.673689:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273536 00000100:00100000:0.0:1789023972.673693:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273536 00000100:00100000:0.0:1789023972.673711:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789023972.673718:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422273536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.673726:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023972.673738:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3715 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673757:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673767:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673776:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e400, rc 0) 00000100:00100000:0.0:1789023972.673803:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422273536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.673808:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789023972.673846:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023972.673857:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023972.673866:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023972.674596:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.674627:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.674650:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc346169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.674661:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273664 00000100:00100000:0.0:1789023972.674665:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273664 00000100:00100000:0.0:1789023972.674687:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789023972.674694:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422273664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.674783:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422273664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.674791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789023972.674822:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.674847:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.674884:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023972.676027:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc346169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.676063:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273792 00000100:00100000:0.0:1789023972.676070:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273792 00000100:00100000:0.0:1789023972.676109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789023972.676117:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422273792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023972.676450:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422273792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.676464:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789023972.676518:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422273792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023972.680583:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10405:1875927422273920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023972.680668:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023972.681622:0:10405:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023972.685728:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422273920 00000100:00100000:1.0:1789023972.685742:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422273920 00000100:00100000:1.0:1789023972.685854:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789023972.685864:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:10405:x1875927422273920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023972.686031:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:10405:x1875927422273920:12345-0@lo:502:llog_process_th.0 Request processed in 168us (5363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023972.686049:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789023972.688909:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10405:1875927422273920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023972.688956:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023972.688967:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023972.688970:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789023972.688976:0:10405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc199e6000 00000020:00000080:2.0:1789023972.688978:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789023972.689341:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10405:1875927422274048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023972.698278:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023972.698344:0:10405:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10062d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023972.698496:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274048 00000100:00100000:0.0:1789023972.698506:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274048 00000100:00100000:0.0:1789023972.698552:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789023972.698561:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:10405:x1875927422274048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023972.698689:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:10405:x1875927422274048:12345-0@lo:502:llog_process_th.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023972.698695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789023972.699596:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:10405:1875927422274048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023972.699632:0:10405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023972.699640:0:10405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023972.699642:0:10405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789023972.699647:0:10405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789023972.699832:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789023972.699854:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023972.699865:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023972.699877:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023972.748284:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023972.748310:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422274176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789023972.748378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023972.748458:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274176 00000100:00100000:3.0:1789023972.748466:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274176 00000100:00100000:3.0:1789023972.748507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789023972.748516:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422274176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789023972.748548:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789023972.748593:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422274176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023972.748600:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789023972.748642:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422274176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789023973.201451:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023974.221682:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023974.484273:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023974.484621:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289664 00000100:00100000:3.0:1789023974.484634:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289664 00000100:00100000:3.0:1789023974.484706:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 269 00000100:00100000:3.0:1789023974.484717:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+9:6174:x1875927402289664:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023974.484739:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023974.484761:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af39e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023974.484799:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023974.484832:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023974.484844:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5000, rc 0) 00000100:00100000:3.0:1789023974.484912:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289664:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 197us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023974.484919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 269 00000100:00100000:0.0:1789023974.491728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023974.491823:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289792 00000100:00100000:1.0:1789023974.491837:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289792 00000100:00100000:1.0:1789023974.491906:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 270 00000100:00100000:1.0:1789023974.491918:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289792:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023974.492122:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289792:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 206us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023974.492132:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 270 00000100:00100000:3.0:1789023974.498008:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023974.504052:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402289920 00000100:00100000:0.0:1789023974.504077:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402289920 00000100:00100000:3.0:1789023974.504291:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 271 00000100:00100000:3.0:1789023974.504308:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289920:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023974.504523:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:6174:x1875927402289920:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 220us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023974.504532:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 271 00000100:00100000:0.0:1789023974.509869:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023974.510103:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290048 00000100:00100000:3.0:1789023974.510116:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290048 00000100:00100000:3.0:1789023974.510209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 272 00000100:00100000:3.0:1789023974.510221:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:6717:x1875927402290048:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023974.510412:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:6717:x1875927402290048:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 193us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023974.510420:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 272 00000100:00100000:3.0:1789023974.515272:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023974.515538:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290176 00000100:00100000:0.0:1789023974.515551:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290176 00000100:00100000:0.0:1789023974.515618:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 273 00000100:00100000:0.0:1789023974.515629:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6717:x1875927402290176:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789023974.515809:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:6717:x1875927402290176:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 181us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023974.515817:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 273 00000100:00100000:1.0:1789023974.797232:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422274304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789023974.797332:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023974.797469:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274304 00000100:00100000:2.0:1789023974.797479:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274304 00000100:00100000:2.0:1789023974.797547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789023974.797558:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422274304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789023974.797603:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789023974.811423:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422274304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 13845us (14070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023974.811447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789023974.813109:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422274304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789023975.244645:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023975.445832:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023975.445987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023975.446433:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023975.446460:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789023975.446528:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290304 00000100:00100000:2.0:1789023975.446541:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290304 00000100:00100000:2.0:1789023975.446600:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 274 00000100:00100000:2.0:1789023975.446613:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402290304:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789023975.446705:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402290304:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023975.446713:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 274 00000100:00100000:0.0:1789023975.447038:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290688 00000100:00100000:0.0:1789023975.447043:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290688 00000100:00100000:0.0:1789023975.447111:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:0.0:1789023975.447131:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290688:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023975.447207:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290688:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 78us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023975.447214:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00080000:2.0:1789023975.447997:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023975.458647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023975.458732:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290816 00000100:00100000:3.0:1789023975.458745:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290816 00000100:00100000:3.0:1789023975.458820:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:3.0:1789023975.458831:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290816:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023975.458929:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290816:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023975.458938:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:1.0:1789023975.460066:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290432 00000100:00100000:1.0:1789023975.460076:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290432 00000100:00080000:2.0:1789023975.460978:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023975.460985:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023975.463495:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290560 00000100:00100000:0.0:1789023975.463514:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290560 00000100:00100000:0.0:1789023975.463682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:0.0:1789023975.463696:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402290432:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023975.463813:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402290432:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 121us (17994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023975.463821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:0.0:1789023975.463862:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:0.0:1789023975.463869:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290560:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023975.463898:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402290560:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (17437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023975.463904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00080000:2.0:1789023975.475224:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789023975.820414:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023975.820448:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422274432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023975.820530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023975.820707:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274432 00000100:00100000:1.0:1789023975.820721:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274432 00000100:00100000:1.0:1789023975.820830:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023975.820842:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422274432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023975.820896:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789023975.820925:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023975.820980:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422274432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023975.820989:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789023975.821130:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d491880 x1875927422274432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023975.821182:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422274432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023975.822265:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023975.822280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422274560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789023975.822362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023975.822687:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274560 00000100:00100000:1.0:1789023975.822698:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274560 00000100:00080000:2.0:1789023975.822750:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023975.822772:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023975.822783:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422274560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789023975.822814:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023975.822892:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422274560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023975.822910:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789023975.823120:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600a80 x1875927422274560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023975.823139:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422274560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789023976.268913:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023976.333506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422274688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789023976.333578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023976.333730:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274688 00000100:00100000:1.0:1789023976.333739:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274688 00000100:00100000:1.0:1789023976.333803:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023976.333812:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422274688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789023976.333842:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023976.333899:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422274688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023976.333907:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789023976.333948:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600a80 x1875927422274688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023976.333970:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422274688:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789023976.334599:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023976.334615:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023976.334657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.334804:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274816 00000100:00100000:0.0:1789023976.334810:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274816 00000100:00100000:0.0:1789023976.334871:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023976.334880:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422274816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023976.334893:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023976.334928:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422274816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023976.334934:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789023976.338618:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789023976.338678:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8a80 x1875927422274816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023976.338702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023976.339398:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422275328:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023976.339486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422275840:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339508:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023976.339537:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789023976.339543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422275200:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023976.339586:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422275712:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339604:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023976.339619:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422276224:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339651:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023976.339678:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275328 00000100:00100000:2.0:1789023976.339684:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275328 00000100:00100000:2.0:1789023976.339725:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275712 00000100:00100000:2.0:1789023976.339729:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275712 00000100:00100000:2.0:1789023976.339748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276224 00000100:00100000:2.0:1789023976.339750:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276224 00000100:00100000:2.0:1789023976.339765:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789023976.339772:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422275328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.339818:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422275328:12345-0@lo:400:kworker.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.339826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789023976.339841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789023976.339848:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422275712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.339947:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422274944:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.339987:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340030:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422275456:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422275968:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340086:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789023976.340108:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422275072:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340127:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340136:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422275584:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340201:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422276096:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340225:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023976.340245:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275200 00000100:00100000:0.0:1789023976.340249:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275200 00000100:00100000:0.0:1789023976.340274:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275456 00000100:00100000:0.0:1789023976.340278:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275456 00000100:00100000:0.0:1789023976.340290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789023976.340295:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422275200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340328:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422275200:12345-0@lo:400:kworker.0 Request processed in 32us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023976.340333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789023976.340347:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023976.340352:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422275456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340382:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422275456:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023976.340396:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023976.340415:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275840 00000100:00100000:0.0:1789023976.340419:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275840 00000100:00100000:0.0:1789023976.340440:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275968 00000100:00100000:0.0:1789023976.340442:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275968 00000100:00100000:0.0:1789023976.340458:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023976.340465:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422275840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340493:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422275840:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023976.340499:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789023976.340509:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023976.340516:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422275968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.340541:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422275968:12345-0@lo:400:kworker.0 Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023976.340545:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789023976.340577:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422275456:0@lo:400:kworker.0 00010000:00080000:0.0:1789023976.340588:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02601500 x1875927422275968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023976.340597:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422275968:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.340756:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422275712:12345-0@lo:400:kworker.0 Request processed in 908us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.340763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789023976.340776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275072 00000100:00100000:2.0:1789023976.340779:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275072 00000100:00100000:2.0:1789023976.340791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422275584 00000100:00100000:2.0:1789023976.340793:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422275584 00000100:00100000:2.0:1789023976.340804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276096 00000100:00100000:2.0:1789023976.340807:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276096 00000100:00100000:2.0:1789023976.340819:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789023976.340824:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422276224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.340849:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422276224:12345-0@lo:400:kworker.0 Request processed in 25us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.340918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789023976.340939:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789023976.340945:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422275072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.340987:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422275072:12345-0@lo:400:kworker.0 Request processed in 42us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.340993:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789023976.341016:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789023976.341022:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422275584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.341049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422275584:12345-0@lo:400:kworker.0 Request processed in 27us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.341054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789023976.341064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789023976.341069:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422276096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.341093:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422276096:12345-0@lo:400:kworker.0 Request processed in 25us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023976.341099:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789023976.341131:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023976.341135:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789023976.341318:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422275200:0@lo:400:kworker.0 00010000:00080000:2.0:1789023976.341332:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02603800 x1875927422275712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023976.341342:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422275712:0@lo:400:kworker.0 00010000:00080000:2.0:1789023976.341352:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02603100 x1875927422276224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023976.341360:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422276224:0@lo:400:kworker.0 00000100:00100000:2.0:1789023976.341382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422275328:0@lo:400:kworker.0 00010000:00080000:2.0:1789023976.341391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600380 x1875927422275840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023976.341399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422275840:0@lo:400:kworker.0 00000100:00100000:3.0:1789023976.341572:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422274944 00000100:00100000:3.0:1789023976.341577:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422274944 00000100:00100000:3.0:1789023976.341612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789023976.341619:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422274944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023976.341658:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422274944:12345-0@lo:400:kworker.0 Request processed in 40us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023976.341664:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789023976.342047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422275072:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.342058:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422275584:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.342068:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422276096:0@lo:400:kworker.0 00000100:00100000:0.0:1789023976.342076:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422274944:0@lo:400:kworker.0 00010000:00010000:3.0:1789023977.302575:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023977.870522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422276352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789023977.870593:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023977.870757:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276352 00000100:00100000:3.0:1789023977.870765:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276352 00000100:00100000:3.0:1789023977.870815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789023977.870824:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422276352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789023977.870855:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789023977.870915:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422276352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023977.870923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023977.871040:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422276352:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789023978.318337:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023979.102088:0:10693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789023979.340392:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023979.919483:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422276480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789023979.919554:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023979.919637:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276480 00000100:00100000:0.0:1789023979.919645:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276480 00000100:00100000:0.0:1789023979.919692:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789023979.919701:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422276480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789023979.919735:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789023979.919785:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422276480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023979.919792:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789023979.919838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422276480:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789023980.366692:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023980.569755:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023980.569802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023980.569830:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023980.569869:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023980.569914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023980.569944:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291200 00000100:00100000:3.0:1789023980.569953:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291200 00000100:00100000:3.0:1789023980.570048:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291072 00000100:00100000:3.0:1789023980.570052:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291072 00000100:00100000:3.0:1789023980.570076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 75 00000100:00100000:1.0:1789023980.570197:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291456 00000100:00100000:1.0:1789023980.570201:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291456 00000100:00100000:1.0:1789023980.570229:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291328 00000100:00100000:1.0:1789023980.570232:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291328 00000100:00100000:1.0:1789023980.570251:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:1.0:1789023980.570259:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291456:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789023980.570337:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291456:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 79us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023980.570345:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:1.0:1789023980.570362:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:1.0:1789023980.570369:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291328:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789023980.570406:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291328:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 37us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023980.570413:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:2.0:1789023980.570495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:2.0:1789023980.570503:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402291072:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789023980.570535:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402291072:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 34us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023980.570541:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:3.0:1789023980.570872:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291200:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023980.570947:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402291200:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 862us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023980.570955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 75 00000100:00080000:3.0:1789023980.570989:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789023980.570993:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789023980.570996:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023980.570998:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789023980.572471:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402290944 00000100:00100000:0.0:1789023980.572481:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402290944 00000100:00100000:0.0:1789023980.572532:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 276 00000100:00100000:0.0:1789023980.572540:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402290944:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023980.572584:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402290944:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 45us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023980.572590:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 276 00000100:00100000:3.0:1789023980.941504:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023980.941529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422276608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023980.941599:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023980.941713:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276608 00000100:00100000:1.0:1789023980.941722:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276608 00000100:00100000:1.0:1789023980.941792:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023980.941813:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422276608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023980.941842:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023980.941890:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422276608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023980.941896:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789023980.942297:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789023980.942339:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d492300 x1875927422276608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023980.942360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422276608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023980.947556:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422276736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789023980.947624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023980.947881:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276736 00000100:00100000:0.0:1789023980.947889:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276736 00000100:00100000:0.0:1789023980.947952:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789023980.948073:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023980.948403:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422276736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789023980.948475:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789023980.948534:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422276736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 573us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023980.948541:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789023980.948617:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a9f80 x1875927422276736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023980.948649:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422276736:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789023981.393309:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023981.452332:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023981.452355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422276864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023981.452427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023981.452494:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276864 00000100:00100000:2.0:1789023981.452502:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276864 00000100:00100000:2.0:1789023981.452557:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789023981.452566:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422276864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023981.452596:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023981.452640:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422276864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023981.452648:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789023981.452670:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789023981.452700:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c4a80 x1875927422276864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023981.452727:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422276864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023981.453115:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422277120:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023981.453187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422277632:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023981.453222:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422278144:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023981.453261:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789023981.453266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422276992:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453302:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023981.453326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422277504:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453347:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023981.453364:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422278016:0@lo:400:kworker.0 00000100:00100000:1.0:1789023981.453384:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.455247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277120 00000100:00100000:3.0:1789023981.455260:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277120 00000100:00100000:3.0:1789023981.455311:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277632 00000100:00100000:3.0:1789023981.455315:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277632 00000100:00100000:3.0:1789023981.455339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278144 00000100:00100000:3.0:1789023981.455342:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278144 00000100:00100000:3.0:1789023981.455359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789023981.455368:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422277120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455452:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422277120:12345-0@lo:400:kworker.0 Request processed in 86us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.455459:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789023981.455476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789023981.455482:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422277632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455510:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422277632:12345-0@lo:400:kworker.0 Request processed in 29us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.455515:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789023981.455525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789023981.455530:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422278144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455567:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422278144:12345-0@lo:400:kworker.0 Request processed in 37us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.455573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789023981.455613:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278016 00000100:00100000:3.0:1789023981.455617:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278016 00000100:00100000:3.0:1789023981.455642:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023981.455648:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422278016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455680:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422278016:12345-0@lo:400:kworker.0 Request processed in 32us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.455685:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023981.455824:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422277376:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.455884:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422277888:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.455927:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422278400:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.455946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.455989:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789023981.455995:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422277248:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456019:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.456039:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422277760:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456058:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.456071:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422278272:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023981.456124:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277888 00000100:00100000:3.0:1789023981.456128:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277888 00000100:00100000:3.0:1789023981.456177:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278400 00000100:00100000:3.0:1789023981.456181:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278400 00000100:00100000:3.0:1789023981.456203:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789023981.456210:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422277888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456246:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422277888:12345-0@lo:400:kworker.0 Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456252:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789023981.456264:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023981.456270:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422278400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456296:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422278400:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456302:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023981.456322:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277504 00000100:00100000:3.0:1789023981.456325:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277504 00000100:00100000:3.0:1789023981.456345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277248 00000100:00100000:3.0:1789023981.456348:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277248 00000100:00100000:3.0:1789023981.456358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789023981.456364:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422277504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456397:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422277504:12345-0@lo:400:kworker.0 Request processed in 33us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456403:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789023981.456413:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789023981.456419:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422277248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456445:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422277248:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789023981.456471:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277376 00000100:00100000:3.0:1789023981.456480:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277376 00000100:00100000:3.0:1789023981.456495:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422277760 00000100:00100000:3.0:1789023981.456497:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422277760 00000100:00100000:3.0:1789023981.456505:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278272 00000100:00100000:3.0:1789023981.456507:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278272 00000100:00100000:3.0:1789023981.456520:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789023981.456525:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422277376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456555:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422277376:12345-0@lo:400:kworker.0 Request processed in 30us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456561:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789023981.456571:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789023981.456577:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422277760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456601:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422277760:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456606:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789023981.456616:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789023981.456622:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422278272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456647:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422278272:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.456652:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789023981.456696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422277504:0@lo:400:kworker.0 00010000:00080000:3.0:1789023981.456710:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d492d80 x1875927422278016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023981.456720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422278016:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422277120:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422277632:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456767:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422278144:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456807:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422277248:0@lo:400:kworker.0 00010000:00080000:3.0:1789023981.456817:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d491c00 x1875927422277760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023981.456825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422277760:0@lo:400:kworker.0 00010000:00080000:3.0:1789023981.456835:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d490e00 x1875927422278272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023981.456843:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422278272:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.456852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422277376:0@lo:400:kworker.0 00010000:00080000:3.0:1789023981.456861:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d492a00 x1875927422277888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023981.456869:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422277888:0@lo:400:kworker.0 00010000:00080000:3.0:1789023981.456878:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ed80 x1875927422278400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023981.456886:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422278400:0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.457923:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422276992 00000100:00100000:3.0:1789023981.457932:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422276992 00000100:00100000:3.0:1789023981.458024:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789023981.458034:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422276992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023981.458098:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422276992:12345-0@lo:400:kworker.0 Request processed in 65us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023981.458202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:2.0:1789023981.458301:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789023981.458308:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023981.458311:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023981.458354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422278528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789023981.458387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023981.458421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278528 00000100:00100000:2.0:1789023981.458424:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278528 00000100:00100000:2.0:1789023981.458450:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789023981.458456:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422278528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789023981.458471:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023981.458503:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422278528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023981.458509:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789023981.458539:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c4a80 x1875927422278528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023981.458557:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422278528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789023981.467036:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422276992:0@lo:400:kworker.0 00010000:00010000:3.0:1789023982.415970:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023982.988446:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023982.988471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422278656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789023982.988844:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023982.988972:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278656 00000100:00100000:1.0:1789023982.988982:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278656 00000100:00100000:1.0:1789023982.989037:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789023982.989046:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422278656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789023982.989077:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789023982.989125:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422278656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023982.989131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789023982.989237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422278656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789023983.436306:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023984.092659:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing yml_node 00010000:00010000:3.0:1789023984.461742:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023985.039219:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422278784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789023985.041403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023985.041501:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278784 00000100:00100000:2.0:1789023985.041509:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278784 00000100:00100000:2.0:1789023985.041558:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789023985.041568:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422278784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789023985.041605:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789023985.041658:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422278784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023985.041665:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789023985.041711:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422278784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789023985.484608:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023985.695672:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023985.695815:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291968 00000100:00100000:1.0:1789023985.695825:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291968 00000100:00100000:1.0:1789023985.695908:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:1.0:1789023985.695927:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402291968:12345-192.168.202.18@tcp:9:kworker.0 00000020:00000080:1.0:1789023985.695965:0:8433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3635 00000100:00080000:1.0:1789023985.695974:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789023985.696026:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789023985.696225:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+2:2399:x1875927402291968:12345-192.168.202.18@tcp:9:kworker.0 Request processed in 309us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023985.696233:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00010000:00010000:0.0:1789023985.696381:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789023985.696886:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023985.704265:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023985.704305:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789023985.704335:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789023985.704446:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291840 00000100:00100000:1.0:1789023985.704458:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291840 00000100:00100000:1.0:1789023985.704555:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291712 00000100:00100000:1.0:1789023985.704559:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291712 00000100:00100000:1.0:1789023985.704584:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 83 00000100:00100000:1.0:1789023985.704594:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402291840:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789023985.704666:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402291840:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 73us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023985.704673:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 83 00000100:00100000:1.0:1789023985.704690:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 84 00000100:00100000:1.0:1789023985.704696:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402291712:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789023985.704720:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402291712:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023985.704725:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 84 00000100:00080000:0.0:1789023985.704887:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023985.704891:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789023985.704945:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402291584 00000100:00100000:3.0:1789023985.704950:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402291584 00000100:00100000:3.0:1789023985.704981:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 278 00000100:00100000:3.0:1789023985.704988:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2402:x1875927402291584:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023985.705014:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2402:x1875927402291584:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 28us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023985.705021:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 278 00000100:00100000:2.0:1789023985.708667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023985.710583:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292096 00000100:00100000:3.0:1789023985.710599:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292096 00000100:00100000:3.0:1789023985.710694:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:3.0:1789023985.710704:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402292096:12345-192.168.202.18@tcp:9:kworker.0 00000020:00000080:3.0:1789023985.710744:0:8904:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb363c 00000100:00080000:3.0:1789023985.710755:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cb02536800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789023985.710810:0:8904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1789023985.710899:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023985.711012:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+2:2399:x1875927402292096:12345-192.168.202.18@tcp:9:kworker.0 Request processed in 309us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023985.711020:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00080000:0.0:1789023985.711219:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789023986.060376:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023986.060401:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422278912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789023986.060481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023986.060514:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422278912 00000100:00100000:2.0:1789023986.060525:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422278912 00000100:00100000:3.0:1789023986.060593:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789023986.060631:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023986.060669:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422278912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789023986.060701:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023986.060756:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422278912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (274us total) trans 0 rc 0/0 00010000:00080000:0.0:1789023986.060816:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8000 x1875927422278912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023986.060836:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422278912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789023986.061522:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023986.061534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422279040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023986.061567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023986.064535:0:8434:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789023986.064558:0:8434:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789023986.065422:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789023986.065456:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279040 00000100:00100000:3.0:1789023986.065465:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279040 00000100:00100000:3.0:1789023986.065536:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023986.065546:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422279040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023986.065572:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023986.065666:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422279040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023986.065673:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789023986.065994:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023986.066044:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90e300 x1875927422279040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023986.066074:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422279040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789023986.508302:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023986.572509:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023986.572536:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023986.572608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023986.572882:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023986.572893:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422279168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789023986.572942:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023986.572986:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279296 00000100:00100000:3.0:1789023986.572994:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279296 00000100:00100000:2.0:1789023986.573224:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789023986.573236:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422279296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023986.573268:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023986.573319:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422279296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023986.573326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789023986.573428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8000 x1875927422279296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023986.573446:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422279296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023986.573523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279168 00000100:00100000:3.0:1789023986.573541:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279168 00000100:00100000:3.0:1789023986.573574:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789023986.573580:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422279168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789023986.573591:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023986.573633:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422279168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023986.573640:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789023986.573795:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c7480 x1875927422279168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023986.573809:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422279168:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789023986.574251:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023986.574537:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422279552:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.574580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023986.574612:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422280064:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.574632:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023986.574650:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789023986.574655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422279680:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.574678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023986.574692:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422280192:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.574708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023986.574733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279552 00000100:00100000:0.0:1789023986.574738:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279552 00000100:00100000:0.0:1789023986.574771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280064 00000100:00100000:0.0:1789023986.574775:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280064 00000100:00100000:0.0:1789023986.574792:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280192 00000100:00100000:0.0:1789023986.574794:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280192 00000100:00100000:0.0:1789023986.574807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789023986.574814:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422279552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.574873:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422279552:12345-0@lo:400:kworker.0 Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023986.574879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789023986.574895:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789023986.574901:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422280064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023986.575017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789023986.575026:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422280192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023986.575082:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422280192:12345-0@lo:400:kworker.0 Request processed in 58us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023986.575088:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789023986.575439:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789023986.575444:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023986.575459:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422279424:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023986.575542:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422279936:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023986.575600:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422280448:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023986.575639:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789023986.575645:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422279808:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023986.575677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422280320:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023986.575715:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279680 00000100:00100000:1.0:1789023986.575720:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279680 00000100:00100000:1.0:1789023986.575749:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279936 00000100:00100000:1.0:1789023986.575752:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279936 00000100:00100000:1.0:1789023986.575767:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789023986.575775:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422279680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.575811:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422279680:12345-0@lo:400:kworker.0 Request processed in 37us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023986.575817:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789023986.575830:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789023986.575836:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422279936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023986.576459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280448 00000100:00100000:3.0:1789023986.576466:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280448 00000100:00100000:3.0:1789023986.576508:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279808 00000100:00100000:3.0:1789023986.576512:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279808 00000100:00100000:3.0:1789023986.576523:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280320 00000100:00100000:3.0:1789023986.576525:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280320 00000100:00100000:3.0:1789023986.576538:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789023986.576544:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576638:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422280064:12345-0@lo:400:kworker.0 Request processed in 1736us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023986.576645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789023986.576662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789023986.576667:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422279808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576702:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422279808:12345-0@lo:400:kworker.0 Request processed in 35us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023986.576721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789023986.576736:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789023986.576741:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422280320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576770:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422280320:12345-0@lo:400:kworker.0 Request processed in 29us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023986.576776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789023986.576813:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422279680:0@lo:400:kworker.0 00010000:00080000:0.0:1789023986.576826:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a9f80 x1875927422280192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023986.576837:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422280192:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576848:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422279552:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576875:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422280064:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422279808:0@lo:400:kworker.0 00000100:00100000:0.0:1789023986.576939:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422280320:0@lo:400:kworker.0 00000100:00080000:0.0:1789023986.576986:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023986.576989:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789023986.578200:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422279424 00000100:00100000:2.0:1789023986.578210:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422279424 00000100:00100000:2.0:1789023986.578271:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789023986.578280:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422279424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023986.578346:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422279424:12345-0@lo:400:kworker.0 Request processed in 68us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023986.578365:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789023986.578417:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422279424:0@lo:400:kworker.0 00000100:00100000:3.0:1789023986.580371:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422280448:12345-0@lo:400:kworker.0 Request processed in 3818us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023986.580384:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789023986.580519:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02602a00 x1875927422280448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023986.580534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422280448:0@lo:400:kworker.0 00000100:00100000:1.0:1789023986.583776:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422279936:12345-0@lo:400:kworker.0 Request processed in 7925us (8181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023986.583795:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789023986.584252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422279936:0@lo:400:kworker.0 00010000:00010000:3.0:1789023987.532332:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023988.120677:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023988.132749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422280576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789023988.132837:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023988.132991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280576 00000100:00100000:1.0:1789023988.133001:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280576 00000100:00100000:1.0:1789023988.133094:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789023988.133105:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422280576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789023988.133187:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789023988.133261:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422280576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023988.133269:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789023988.136044:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422280576:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789023988.500290:0:11121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789023988.556558:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023989.582462:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023990.156742:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422280704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789023990.156812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023990.157001:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280704 00000100:00100000:3.0:1789023990.157009:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280704 00000100:00100000:3.0:1789023990.157064:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789023990.157074:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422280704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789023990.157105:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789023990.157182:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422280704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023990.157189:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789023990.157266:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422280704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789023990.614557:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023990.804131:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023990.804219:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023990.804574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023990.804610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292480 00000100:00100000:3.0:1789023990.804619:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292480 00000100:00100000:3.0:1789023990.804675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292352 00000100:00100000:3.0:1789023990.804678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292352 00000100:00100000:3.0:1789023990.804701:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 91 00000100:00100000:3.0:1789023990.804711:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402292480:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023990.804784:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402292480:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 75us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023990.804791:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 91 00000100:00100000:3.0:1789023990.804811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 92 00000100:00100000:3.0:1789023990.804819:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402292352:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023990.804844:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402292352:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023990.804850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 92 00000100:00080000:3.0:1789023990.804876:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023990.804880:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789023990.806046:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292224 00000100:00100000:1.0:1789023990.806057:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292224 00000100:00100000:1.0:1789023990.806105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 280 00000100:00100000:1.0:1789023990.806114:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402292224:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789023990.806556:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402292224:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 441us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023990.806564:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 280 00000001:02000400:3.0:1789023990.954227:0:11218:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:2.0:1789023991.182798:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422280832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789023991.182883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023991.182962:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280832 00000100:00100000:2.0:1789023991.182970:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280832 00000100:00100000:2.0:1789023991.183027:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789023991.183036:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422280832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789023991.183063:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023991.183108:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422280832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023991.183114:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789023991.183135:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023991.183201:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c6300 x1875927422280832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023991.183217:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422280832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789023991.185615:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422280960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023991.185698:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023991.185763:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422280960 00000100:00100000:2.0:1789023991.185770:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422280960 00000100:00100000:2.0:1789023991.185821:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789023991.185830:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422280960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023991.185849:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023991.185901:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422280960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023991.185907:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789023991.185927:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023991.185952:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ed80 x1875927422280960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023991.185971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422280960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789023991.628534:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023991.693482:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422281088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789023991.693546:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023991.693608:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281088 00000100:00100000:2.0:1789023991.693615:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281088 00000100:00100000:2.0:1789023991.693664:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023991.693671:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422281088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789023991.693698:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023991.693735:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422281088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023991.693743:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789023991.693761:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789023991.693785:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c7800 x1875927422281088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023991.693802:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422281088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789023991.696093:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422281344:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696210:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422281856:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696260:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422282368:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696283:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696315:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789023991.696320:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422281472:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696360:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422281984:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281344 00000100:00100000:0.0:1789023991.696413:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281344 00000100:00100000:0.0:1789023991.696451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281856 00000100:00100000:0.0:1789023991.696454:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281856 00000100:00100000:0.0:1789023991.696478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281984 00000100:00100000:0.0:1789023991.696481:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281984 00000100:00100000:0.0:1789023991.696498:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789023991.696506:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422281344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696554:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422281344:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.696561:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789023991.696581:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789023991.696588:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422281856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696615:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422281856:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.696621:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789023991.696639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789023991.696646:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422281984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696673:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422281984:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.696679:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789023991.696699:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282368 00000100:00100000:0.0:1789023991.696703:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282368 00000100:00100000:0.0:1789023991.696730:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023991.696737:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422282368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696766:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422282368:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.696772:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789023991.696810:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a9c00 x1875927422281984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023991.696824:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422281984:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696834:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422281344:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696843:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422281856:0@lo:400:kworker.0 00010000:00080000:0.0:1789023991.696852:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8e00 x1875927422282368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023991.696876:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422282368:0@lo:400:kworker.0 00000100:00080000:0.0:1789023991.696906:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023991.696910:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789023991.696912:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023991.696922:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422281600:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696953:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696968:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422282112:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.696984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.696998:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789023991.697003:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422281216:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697026:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.697046:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422281728:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.697082:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422282240:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697101:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023991.697118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281600 00000100:00100000:0.0:1789023991.697121:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281600 00000100:00100000:0.0:1789023991.697138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282112 00000100:00100000:0.0:1789023991.697140:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282112 00000100:00100000:0.0:1789023991.697176:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282240 00000100:00100000:0.0:1789023991.697179:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282240 00000100:00100000:0.0:1789023991.697192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789023991.697197:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422281600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697228:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422281600:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789023991.697244:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789023991.697249:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422282112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697273:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422282112:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697279:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789023991.697297:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789023991.697303:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422282240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697329:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422282240:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697335:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789023991.697352:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281216 00000100:00100000:0.0:1789023991.697355:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281216 00000100:00100000:0.0:1789023991.697379:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789023991.697386:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422281216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697411:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422281216:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697417:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789023991.697441:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281472 00000100:00100000:0.0:1789023991.697444:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281472 00000100:00100000:0.0:1789023991.697463:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422281728 00000100:00100000:0.0:1789023991.697466:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422281728 00000100:00100000:0.0:1789023991.697476:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789023991.697482:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697514:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422281472:12345-0@lo:400:kworker.0 Request processed in 32us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697520:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789023991.697531:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789023991.697536:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422281728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697560:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422281728:12345-0@lo:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023991.697565:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789023991.697598:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422281472:0@lo:400:kworker.0 00000100:00080000:0.0:1789023991.697618:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789023991.697621:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023991.697635:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422281216:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697643:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422281728:0@lo:400:kworker.0 00010000:00080000:0.0:1789023991.697652:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8a80 x1875927422282240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023991.697661:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422282240:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697671:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422281600:0@lo:400:kworker.0 00000100:00100000:0.0:1789023991.697679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422282112:0@lo:400:kworker.0 00000001:00100000:2.0:1789023991.703364:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:2.0:1789023991.703375:0:9511:0:(genops.c:885:class_export_put()) final put ffff90cb02531800/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:0.0:1789023991.704123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb02531800/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-OST0001 00000020:00000080:0.0:1789023991.704203:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb02536800 for lustre-OST0001 00000100:00100000:1.0:1789023991.705186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422282496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023991.710250:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023991.711575:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282496 00000100:00100000:3.0:1789023991.711587:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282496 00000100:00100000:3.0:1789023991.711696:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789023991.711707:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422282496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023991.711734:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023991.711803:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422282496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023991.711820:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789023991.712332:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ed80 x1875927422282496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023991.712353:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422282496:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789023991.715502:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:0.0:1789023991.715515:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cc3bf98800/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:1.0:1789023991.715577:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf98800/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-OST0000 00000020:00000080:1.0:1789023991.715649:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3bf9a800 for lustre-OST0000 00010000:00010000:0.0:1789023992.652472:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023993.233906:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023993.237709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422282624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789023993.237821:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023993.238053:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282624 00000100:00100000:0.0:1789023993.238065:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282624 00000100:00100000:0.0:1789023993.238133:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789023993.238143:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422282624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789023993.238216:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789023993.238274:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422282624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023993.238281:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789023993.238812:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422282624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789023993.678435:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789023994.141932:0:11316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:1.0:1789023994.702305:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023995.276624:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422282752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789023995.276696:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023995.276879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282752 00000100:00100000:3.0:1789023995.276888:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282752 00000100:00100000:3.0:1789023995.276932:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789023995.276941:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422282752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789023995.276974:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789023995.277036:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422282752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023995.277044:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789023995.277469:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422282752:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789023995.724560:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023995.858634:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 03:06:34 EDT 2026 00000100:00100000:3.0:1789023995.924839:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023995.924882:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023995.924915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789023995.924942:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292864 00000100:00100000:3.0:1789023995.924951:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292864 00000100:00100000:3.0:1789023995.925005:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292736 00000100:00100000:3.0:1789023995.925007:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292736 00000100:00100000:3.0:1789023995.925029:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:3.0:1789023995.925037:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402292864:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789023995.925104:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402292864:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023995.925110:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:3.0:1789023995.925126:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 100 00000100:00100000:3.0:1789023995.925131:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402292736:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023995.925288:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292608 00000100:00100000:0.0:1789023995.925293:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292608 00000100:00100000:0.0:1789023995.925338:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 282 00000100:00100000:0.0:1789023995.925346:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2403:x1875927402292608:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789023995.925373:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+10:2403:x1875927402292608:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023995.925380:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 282 00000100:00100000:3.0:1789023995.925523:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402292736:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 391us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023995.925537:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 100 00000100:00080000:3.0:1789023995.925555:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023995.925559:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789023996.301254:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422282880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789023996.301347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.301406:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023996.301413:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422283008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023996.301450:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.301486:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422282880 00000100:00100000:0.0:1789023996.301493:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422282880 00000100:00100000:0.0:1789023996.301539:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283008 00000100:00100000:0.0:1789023996.301542:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283008 00000100:00100000:0.0:1789023996.301557:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789023996.301564:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422282880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789023996.301594:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023996.301631:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422282880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.301638:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789023996.301653:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789023996.301658:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422283008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023996.301666:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789023996.301685:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422283008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.301691:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789023996.301720:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023996.301748:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039e8000 x1875927422283008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023996.301767:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422283008:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789023996.301778:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c7800 x1875927422282880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023996.301788:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422282880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789023996.750005:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023996.812670:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023996.812700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422283136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789023996.812789:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023996.813465:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422283264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023996.813496:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023996.813829:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283136 00000100:00100000:3.0:1789023996.813838:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283136 00000100:00100000:3.0:1789023996.813907:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283264 00000100:00100000:3.0:1789023996.813910:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283264 00000100:00100000:3.0:1789023996.813928:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789023996.813935:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422283136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789023996.813967:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789023996.814021:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422283136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023996.814028:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789023996.814543:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789023996.814555:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422283264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023996.814567:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789023996.814599:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422283264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023996.814605:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789023996.814675:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789023996.814895:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c4000 x1875927422283264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023996.814916:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422283264:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789023996.814928:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c5500 x1875927422283136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023996.814941:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422283136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789023996.817020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422283648:0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.817218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023996.817251:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422284160:0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.817276:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023996.817303:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789023996.817309:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422283776:0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.817329:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023996.817346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422284288:0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.817366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023996.817414:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283648 00000100:00100000:1.0:1789023996.817421:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283648 00000100:00100000:1.0:1789023996.817462:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789023996.817471:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422283648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.817521:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422283648:12345-0@lo:400:kworker.0 Request processed in 51us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023996.817527:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789023996.817574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422283648:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.817883:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422283392:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.817921:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.817947:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422283904:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.817970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.817986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422284416:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.818029:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789023996.818035:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422283520:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.818139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422284032:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023996.818263:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283392 00000100:00100000:0.0:1789023996.818268:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283392 00000100:00100000:0.0:1789023996.818303:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789023996.818310:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422283392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818347:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422283392:12345-0@lo:400:kworker.0 Request processed in 37us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818368:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789023996.818401:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283904 00000100:00100000:0.0:1789023996.818405:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283904 00000100:00100000:0.0:1789023996.818428:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789023996.818434:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422283904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818466:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422283904:12345-0@lo:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818472:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789023996.818489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284160 00000100:00100000:0.0:1789023996.818492:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284160 00000100:00100000:0.0:1789023996.818520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283776 00000100:00100000:0.0:1789023996.818523:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283776 00000100:00100000:0.0:1789023996.818532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284288 00000100:00100000:0.0:1789023996.818535:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284288 00000100:00100000:0.0:1789023996.818547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284416 00000100:00100000:0.0:1789023996.818549:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284416 00000100:00100000:0.0:1789023996.818560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422283520 00000100:00100000:0.0:1789023996.818562:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422283520 00000100:00100000:0.0:1789023996.818570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284032 00000100:00100000:0.0:1789023996.818572:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284032 00000100:00100000:0.0:1789023996.818585:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023996.818590:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422284160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818620:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422284160:12345-0@lo:400:kworker.0 Request processed in 29us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023996.818638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789023996.818643:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422283776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818667:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422283776:12345-0@lo:400:kworker.0 Request processed in 24us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789023996.818690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789023996.818696:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422284288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818723:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422284288:12345-0@lo:400:kworker.0 Request processed in 27us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789023996.818739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023996.818744:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422284416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818767:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422284416:12345-0@lo:400:kworker.0 Request processed in 23us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818773:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023996.818782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789023996.818787:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422283520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818821:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422283520:12345-0@lo:400:kworker.0 Request processed in 23us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789023996.818839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789023996.818845:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422284032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818886:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422284032:12345-0@lo:400:kworker.0 Request processed in 41us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023996.818893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789023996.818930:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422283520:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422284032:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818959:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422283392:0@lo:400:kworker.0 00000100:00100000:0.0:1789023996.818970:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422283904:0@lo:400:kworker.0 00010000:00080000:0.0:1789023996.818981:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039eb480 x1875927422284416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023996.818991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422284416:0@lo:400:kworker.0 00000100:00080000:0.0:1789023996.819019:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023996.819023:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789023996.819782:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422283776:0@lo:400:kworker.0 00000100:00100000:1.0:1789023996.819796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422284288:0@lo:400:kworker.0 00010000:00080000:1.0:1789023996.819816:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039eaa00 x1875927422284160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023996.819827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422284160:0@lo:400:kworker.0 00010000:00010000:2.0:1789023997.776591:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023998.358074:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023998.358097:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422284544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789023998.358190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023998.358253:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284544 00000100:00100000:3.0:1789023998.358260:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284544 00000100:00100000:3.0:1789023998.358308:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789023998.358317:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422284544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789023998.358362:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789023998.358407:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422284544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023998.358414:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789023998.358460:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422284544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789023998.798801:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023999.820799:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024000.399165:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024000.399191:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422284672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024000.399262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024000.399333:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284672 00000100:00100000:2.0:1789024000.399341:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284672 00000100:00100000:2.0:1789024000.399388:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789024000.399396:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422284672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024000.399430:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024000.399475:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422284672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024000.399482:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789024000.399527:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422284672:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024000.848417:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024001.046127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024001.046189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024001.046222:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024001.046259:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293248 00000100:00100000:3.0:1789024001.046271:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293248 00000100:00100000:3.0:1789024001.046340:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293120 00000100:00100000:3.0:1789024001.046344:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293120 00000100:00100000:3.0:1789024001.046369:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:3.0:1789024001.046380:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402293248:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024001.046459:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402293248:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024001.046467:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:3.0:1789024001.046485:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:3.0:1789024001.046491:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402293120:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024001.046518:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402293120:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024001.046524:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:0.0:1789024001.051058:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402292992 00000100:00100000:0.0:1789024001.051079:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402292992 00000100:00100000:0.0:1789024001.051184:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 284 00000100:00100000:0.0:1789024001.051197:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2402:x1875927402292992:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024001.051279:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2402:x1875927402292992:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 85us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024001.051287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 284 00000100:00080000:0.0:1789024001.051328:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024001.051333:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024001.421707:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024001.421741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422284800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024001.421931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024001.422028:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284800 00000100:00100000:3.0:1789024001.422037:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284800 00000100:00100000:3.0:1789024001.422106:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789024001.422117:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422284800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024001.422184:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024001.422239:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422284800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024001.422246:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789024001.422291:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039eaa00 x1875927422284800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024001.422311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422284800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789024001.422588:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024001.431077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422284928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024001.431175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024001.431267:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422284928 00000100:00100000:2.0:1789024001.431276:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422284928 00000100:00100000:2.0:1789024001.431337:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789024001.431354:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422284928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024001.431380:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024001.436650:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422284928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5289us (5466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024001.436666:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789024001.436701:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789024001.438363:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021e2d80 x1875927422284928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.438390:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422284928:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789024001.868380:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024001.932704:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422285440:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.932859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.932916:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422285952:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.932936:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.932963:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789024001.932968:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422285056:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.932994:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933016:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422285568:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933039:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933056:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422286080:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933076:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422285184:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933388:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422285696:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933415:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422286208:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933438:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933457:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789024001.933463:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422285312:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933483:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933500:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422285824:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933519:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422286336:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933546:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.933577:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285440 00000100:00100000:1.0:1789024001.933592:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285440 00000100:00100000:1.0:1789024001.933628:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285952 00000100:00100000:1.0:1789024001.933631:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285952 00000100:00100000:1.0:1789024001.933652:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286080 00000100:00100000:1.0:1789024001.933654:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286080 00000100:00100000:1.0:1789024001.933664:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285184 00000100:00100000:1.0:1789024001.933666:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285184 00000100:00100000:1.0:1789024001.933674:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285696 00000100:00100000:1.0:1789024001.933676:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285696 00000100:00100000:1.0:1789024001.933686:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285824 00000100:00100000:1.0:1789024001.933688:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285824 00000100:00100000:1.0:1789024001.933701:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024001.933709:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422285440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933778:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422285440:12345-0@lo:400:kworker.0 Request processed in 69us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.933785:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024001.933810:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024001.933816:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422285952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.933845:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422285952:12345-0@lo:400:kworker.0 Request processed in 29us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.933851:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024001.933863:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789024001.933870:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422286080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.934596:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422286080:12345-0@lo:400:kworker.0 Request processed in 28us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.934607:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789024001.934625:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024001.934633:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.934685:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422285184:12345-0@lo:400:kworker.0 Request processed in 54us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.934690:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024001.934704:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789024001.934710:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422285696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.934754:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422285696:12345-0@lo:400:kworker.0 Request processed in 44us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935081:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789024001.935099:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789024001.935107:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422285824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935170:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422285824:12345-0@lo:400:kworker.0 Request processed in 65us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935176:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789024001.935213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285568 00000100:00100000:1.0:1789024001.935220:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285568 00000100:00100000:1.0:1789024001.935327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285312 00000100:00100000:1.0:1789024001.935332:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285312 00000100:00100000:1.0:1789024001.935348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789024001.935353:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422285568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935388:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422285568:12345-0@lo:400:kworker.0 Request processed in 35us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935394:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789024001.935408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789024001.935414:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422285312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935441:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422285312:12345-0@lo:400:kworker.0 Request processed in 28us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935458:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789024001.935484:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286208 00000100:00100000:1.0:1789024001.935489:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286208 00000100:00100000:1.0:1789024001.935524:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286336 00000100:00100000:1.0:1789024001.935527:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286336 00000100:00100000:1.0:1789024001.935549:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789024001.935556:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc35736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422286208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935588:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc35736450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422286208:12345-0@lo:400:kworker.0 Request processed in 33us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935594:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789024001.935759:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789024001.935779:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422286336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935808:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422286336:12345-0@lo:400:kworker.0 Request processed in 31us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.935814:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789024001.935862:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422285312:0@lo:400:kworker.0 00010000:00080000:1.0:1789024001.935877:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039e9c00 x1875927422285824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.935888:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422285824:0@lo:400:kworker.0 00010000:00080000:1.0:1789024001.935897:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f954700 x1875927422286336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.935905:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422286336:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935916:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422285184:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422285696:0@lo:400:kworker.0 00010000:00080000:1.0:1789024001.935947:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f957100 x1875927422286208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.935957:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422286208:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.935994:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422285568:0@lo:400:kworker.0 00010000:00080000:1.0:1789024001.936005:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f954000 x1875927422286080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.936014:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422286080:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.936025:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422285440:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.936035:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422285952:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.939254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024001.939278:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422286464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024001.939346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024001.939394:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286464 00000100:00100000:1.0:1789024001.939402:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286464 00000100:00100000:1.0:1789024001.939460:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789024001.939469:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422286464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024001.939501:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024001.939544:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422286464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.939550:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789024001.939600:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f954000 x1875927422286464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024001.939619:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422286464:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789024001.941666:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789024001.941691:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024001.941695:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024001.941919:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422285056 00000100:00100000:1.0:1789024001.941931:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422285056 00000100:00100000:1.0:1789024001.942002:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789024001.942013:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422285056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.942325:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422285056:12345-0@lo:400:kworker.0 Request processed in 99us (9114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024001.942335:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789024001.943572:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422285056:0@lo:400:kworker.0 00000100:00100000:1.0:1789024001.946541:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422286592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024001.946622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024001.947264:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286592 00000100:00100000:2.0:1789024001.947276:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286592 00000100:00100000:2.0:1789024001.947338:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789024001.947349:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422286592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024001.947376:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024001.947443:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422286592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024001.947451:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789024001.947845:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f954000 x1875927422286592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024001.947869:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422286592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789024002.892307:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024003.470370:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422286720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024003.470489:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024003.470607:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286720 00000100:00100000:1.0:1789024003.470616:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286720 00000100:00100000:1.0:1789024003.470666:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789024003.470677:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422286720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024003.470715:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024003.470782:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422286720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024003.470790:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789024003.470855:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422286720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024003.916498:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024004.940595:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024005.517268:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024005.517290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422286848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024005.517361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024005.517452:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286848 00000100:00100000:3.0:1789024005.517464:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286848 00000100:00100000:3.0:1789024005.517558:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789024005.517568:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422286848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024005.517610:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024005.517670:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422286848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024005.517677:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789024005.519510:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422286848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024005.967503:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024006.167515:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024006.167570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024006.167599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024006.167633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293504 00000100:00100000:3.0:1789024006.167642:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293504 00000100:00100000:3.0:1789024006.167707:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293632 00000100:00100000:3.0:1789024006.167712:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293632 00000100:00100000:3.0:1789024006.167747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00100000:3.0:1789024006.167770:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402293504:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024006.167954:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402293504:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024006.167964:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00100000:3.0:1789024006.167984:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00100000:3.0:1789024006.167991:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402293632:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024006.168017:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402293632:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024006.168023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00080000:3.0:1789024006.168041:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024006.168045:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024006.168258:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293376 00000100:00100000:2.0:1789024006.168263:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293376 00000100:00100000:2.0:1789024006.168303:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 286 00000100:00100000:2.0:1789024006.168309:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402293376:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024006.168345:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402293376:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 37us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024006.168351:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 286 00000100:00100000:3.0:1789024006.541577:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024006.541613:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422286976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024006.541738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024006.541800:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422286976 00000100:00100000:2.0:1789024006.541816:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422286976 00000100:00100000:2.0:1789024006.541902:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789024006.541913:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422286976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024006.541944:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789024006.542056:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024006.542089:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024006.542104:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422287104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024006.542177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024006.542292:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287104 00000100:00100000:3.0:1789024006.542299:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287104 00000100:00100000:3.0:1789024006.542345:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789024006.542354:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422287104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024006.542373:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024006.542417:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422287104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024006.542425:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789024006.542447:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024006.548092:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422286976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6167us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024006.548112:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789024006.551402:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f956300 x1875927422287104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024006.551436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422287104:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789024006.551971:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021e1180 x1875927422286976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024006.552002:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422286976:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789024006.992961:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024007.052417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024007.052454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422287232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024007.052571:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024007.052759:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287232 00000100:00100000:1.0:1789024007.052769:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287232 00000100:00100000:1.0:1789024007.052831:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789024007.052842:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422287232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024007.052878:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024007.052929:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422287232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024007.052937:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789024007.052993:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f957800 x1875927422287232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024007.053015:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422287232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024007.053216:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422287360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024007.053243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024007.053274:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287360 00000100:00100000:1.0:1789024007.053278:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287360 00000100:00100000:1.0:1789024007.053305:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789024007.053311:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422287360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024007.053323:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024007.053354:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422287360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024007.053367:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789024007.053398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f957800 x1875927422287360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024007.053411:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422287360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024007.054348:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422287488:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.054448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422288000:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054470:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.054511:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422288512:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.054557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789024007.054562:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422287616:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054841:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.054913:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422288128:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.054963:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422288640:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.054986:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024007.055033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287488 00000100:00100000:1.0:1789024007.055044:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287488 00000100:00100000:0.0:1789024007.055058:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288000 00000100:00100000:0.0:1789024007.055068:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288000 00000100:00100000:1.0:1789024007.055111:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789024007.055124:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422287488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055137:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789024007.055185:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422288000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.055223:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422287488:12345-0@lo:400:kworker.0 Request processed in 100us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024007.055233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789024007.055252:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422288000:12345-0@lo:400:kworker.0 Request processed in 105us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.055260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789024007.055311:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288512 00000100:00100000:0.0:1789024007.055316:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288512 00000100:00100000:1.0:1789024007.055332:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422287488:0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.055352:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422288000:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055363:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789024007.055373:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422288512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055406:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422288512:12345-0@lo:400:kworker.0 Request processed in 35us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.055412:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789024007.055431:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287616 00000100:00100000:0.0:1789024007.055434:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287616 00000100:00100000:0.0:1789024007.055461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288128 00000100:00100000:0.0:1789024007.055463:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288128 00000100:00100000:0.0:1789024007.055491:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288640 00000100:00100000:0.0:1789024007.055494:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288640 00000100:00100000:0.0:1789024007.055503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789024007.055506:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422287616:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789024007.055530:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ca80 x1875927422288512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024007.055531:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422287616:12345-0@lo:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.055556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789024007.055569:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422288512:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789024007.055595:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422288128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.055619:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422287616:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055646:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422288128:12345-0@lo:400:kworker.0 Request processed in 54us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024007.055647:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422288128:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055664:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789024007.055687:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789024007.055698:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422288640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055902:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422288640:12345-0@lo:400:kworker.0 Request processed in 208us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.055908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789024007.055943:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422287872:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.055968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.055986:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422288384:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.056006:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.056025:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789024007.056031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422287744:0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.056080:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.056096:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422288256:0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.056123:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288384 00000100:00100000:1.0:1789024007.056131:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288384 00000100:00100000:0.0:1789024007.056140:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024007.056190:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422288768:0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.056208:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789024007.056217:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024007.056222:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422288384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.056251:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287872 00000100:00100000:0.0:1789024007.056259:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287872 00000100:00100000:0.0:1789024007.056289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288256 00000100:00100000:0.0:1789024007.056292:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288256 00000100:00100000:0.0:1789024007.056312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288768 00000100:00100000:1.0:1789024007.056313:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422288384:12345-0@lo:400:kworker.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.056318:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288768 00000100:00100000:1.0:1789024007.056327:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789024007.056343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789024007.056354:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422287872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.056369:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422287744 00000100:00100000:0.0:1789024007.056400:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422287872:12345-0@lo:400:kworker.0 Request processed in 48us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.056407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789024007.056423:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789024007.056429:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422288256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.056453:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422288256:12345-0@lo:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.056458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789024007.056471:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789024007.056478:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422288768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024007.056503:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422288768:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024007.056509:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1789024007.056728:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024007.056743:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024007.056746:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024007.057751:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422287744 00000100:00100000:1.0:1789024007.057818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789024007.057827:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422287744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.057913:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422287744:12345-0@lo:400:kworker.0 Request processed in 88us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024007.057921:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789024007.058008:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422287744:0@lo:400:kworker.0 00010000:00080000:1.0:1789024007.058029:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ce00 x1875927422288256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024007.058040:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422288256:0@lo:400:kworker.0 00010000:00080000:1.0:1789024007.058053:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8f100 x1875927422288768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024007.058061:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422288768:0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.058090:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422287872:0@lo:400:kworker.0 00010000:00080000:1.0:1789024007.058103:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8df80 x1875927422288384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024007.058111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422288384:0@lo:400:kworker.0 00000100:00100000:1.0:1789024007.058187:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422288640:0@lo:400:kworker.0 00010000:00010000:1.0:1789024008.014223:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024008.590297:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024008.590335:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422288896:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024008.590407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024008.590518:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422288896 00000100:00100000:2.0:1789024008.590527:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422288896 00000100:00100000:2.0:1789024008.590583:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789024008.590592:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422288896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024008.590626:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789024008.590739:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422288896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024008.590746:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789024008.590790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422288896:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024009.036988:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024010.061142:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024010.637539:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024010.640578:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422289024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024010.641671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024010.646789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289024 00000100:00100000:1.0:1789024010.646810:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289024 00000100:00100000:1.0:1789024010.649213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789024010.649245:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422289024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024010.649667:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024010.649810:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422289024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 580us (8142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024010.649819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789024010.649991:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422289024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789024011.084257:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024011.283218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024011.283249:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024011.283282:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024011.283308:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294016 00000100:00100000:3.0:1789024011.283317:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294016 00000100:00100000:3.0:1789024011.283365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293888 00000100:00100000:3.0:1789024011.283368:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293888 00000100:00100000:3.0:1789024011.283386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 123 00000100:00100000:3.0:1789024011.283394:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402294016:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024011.283456:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402294016:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.283464:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 123 00000100:00100000:3.0:1789024011.283478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00100000:3.0:1789024011.283483:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402293888:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024011.283503:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402293888:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 20us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.283508:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00080000:3.0:1789024011.283525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024011.283529:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024011.283850:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402293760 00000100:00100000:1.0:1789024011.283855:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402293760 00000100:00100000:1.0:1789024011.283888:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 288 00000100:00100000:1.0:1789024011.283895:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402293760:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024011.283926:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402293760:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 32us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024011.283932:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 288 00000001:02000400:3.0:1789024011.390862:0:11993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:06:50 (1789024010) === 00000100:00100000:1.0:1789024011.660434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024011.660463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422289152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024011.660533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024011.660639:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289152 00000100:00100000:2.0:1789024011.660648:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289152 00000100:00080000:3.0:1789024011.660767:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024011.660850:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789024011.660862:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422289152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024011.660866:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422289280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024011.660895:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789024011.660904:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024011.660979:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422289152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.660993:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789024011.668594:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021e1180 x1875927422289152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024011.668622:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422289152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024011.671100:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289280 00000100:00100000:3.0:1789024011.671116:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289280 00000100:00100000:3.0:1789024011.671209:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789024011.671220:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422289280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024011.671247:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024011.671331:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422289280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (10435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.671339:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789024011.671496:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789024011.671536:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a9f80 x1875927422289280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024011.671559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422289280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024011.880736:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024011.880873:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294144 00000100:00100000:1.0:1789024011.880884:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294144 00000100:00100000:1.0:1789024011.880964:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 289 00000100:00100000:1.0:1789024011.880975:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+10:8727:x1875927402294144:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789024011.880991:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024011.881011:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb372a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af3a5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.881071:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3a5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.881083:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3a5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.881092:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161c00, rc 0) 00000100:00100000:1.0:1789024011.881201:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294144:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 227us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024011.881209:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 289 00000100:00100000:3.0:1789024011.901251:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024011.903049:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294272 00000100:00100000:2.0:1789024011.903064:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294272 00000100:00100000:2.0:1789024011.903140:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 290 00000100:00100000:2.0:1789024011.903198:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294272:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789024011.903372:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294272:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 177us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024011.903381:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 290 00000100:00100000:0.0:1789024011.909423:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024011.909517:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294400 00000100:00100000:3.0:1789024011.909528:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294400 00000100:00100000:3.0:1789024011.909585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 291 00000100:00100000:3.0:1789024011.909596:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294400:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789024011.910011:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294400:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 416us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.910020:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 291 00000100:00100000:3.0:1789024011.917628:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024011.917739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294528 00000100:00100000:1.0:1789024011.917750:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294528 00000100:00100000:1.0:1789024011.917815:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 292 00000100:00100000:1.0:1789024011.917826:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294528:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024011.918000:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294528:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 175us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024011.918009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 292 00000100:00100000:0.0:1789024011.955658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024011.955772:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294656 00000100:00100000:3.0:1789024011.955783:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294656 00000100:00100000:3.0:1789024011.955839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 293 00000100:00100000:3.0:1789024011.955850:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294656:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789024011.956290:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294656:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 440us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.956309:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 293 00000100:00100000:0.0:1789024011.970088:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024011.970979:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294784 00000100:00100000:2.0:1789024011.970990:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294784 00000100:00100000:2.0:1789024011.971061:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 294 00000100:00100000:2.0:1789024011.971071:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294784:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789024011.971277:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+11:8731:x1875927402294784:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 206us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024011.971285:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 294 00000100:00100000:2.0:1789024011.986066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024011.987708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402294912 00000100:00100000:1.0:1789024011.987725:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402294912 00000100:00100000:1.0:1789024011.987805:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 295 00000100:00100000:1.0:1789024011.987815:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:8727:x1875927402294912:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789024011.987833:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024011.988325:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af3d6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.988364:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3d6 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.988391:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3d6 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024011.988402:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160600, rc 0) 00000100:00100000:1.0:1789024011.988471:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:8727:x1875927402294912:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 657us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024011.988479:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 295 00000100:00100000:1.0:1789024011.992823:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024011.993032:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295040 00000100:00100000:0.0:1789024011.993042:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295040 00000100:00100000:0.0:1789024011.993100:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 296 00000100:00100000:0.0:1789024011.993110:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:8727:x1875927402295040:12345-192.168.202.18@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789024011.993136:0:6508:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789024011.993193:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789024011.993198:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789024011.993202:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789024011.993205:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789024011.993207:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789024011.996518:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:8727:x1875927402295040:12345-192.168.202.18@tcp:256:mount.lustre.0 Request processed in 3395us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024011.996534:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 296 00000100:00100000:2.0:1789024012.002702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.002819:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295168 00000100:00100000:1.0:1789024012.002831:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295168 00000100:00100000:1.0:1789024012.002893:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 297 00000100:00100000:1.0:1789024012.002903:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:8727:x1875927402295168:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789024012.002926:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024012.002947:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af3dd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024012.002975:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024012.002986:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024012.002994:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160400, rc 0) 00000100:00100000:1.0:1789024012.003067:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:8727:x1875927402295168:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 166us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.003075:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 297 00000100:00100000:1.0:1789024012.005542:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024012.005622:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295296 00000100:00100000:3.0:1789024012.005631:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295296 00000100:00100000:3.0:1789024012.005690:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 298 00000100:00100000:3.0:1789024012.005699:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:8727:x1875927402295296:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789024012.005871:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:8727:x1875927402295296:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 172us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.005880:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 298 00000100:00100000:0.0:1789024012.013202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024012.018341:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295424 00000100:00100000:3.0:1789024012.018357:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295424 00000100:00100000:2.0:1789024012.020648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 299 00000100:00100000:2.0:1789024012.020661:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:8727:x1875927402295424:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789024012.024713:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:8727:x1875927402295424:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 4041us (11513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024012.024728:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 299 00000100:00100000:2.0:1789024012.035328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.035515:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295552 00000100:00100000:1.0:1789024012.035526:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295552 00000100:00100000:1.0:1789024012.035578:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 300 00000100:00100000:1.0:1789024012.035588:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:8734:x1875927402295552:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024012.035869:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:8734:x1875927402295552:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 281us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.035877:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 300 00000100:00100000:1.0:1789024012.052586:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024012.052701:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295680 00000100:00100000:2.0:1789024012.052733:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295680 00000100:00100000:2.0:1789024012.052801:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 301 00000100:00100000:2.0:1789024012.052812:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:8734:x1875927402295680:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789024012.052979:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:8734:x1875927402295680:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 168us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024012.052987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 301 00000100:00100000:2.0:1789024012.069542:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024012.069774:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024012.069906:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024012.069932:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296448 00000100:00100000:3.0:1789024012.069950:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296448 00000100:00100000:0.0:1789024012.070041:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296576 00000100:00100000:0.0:1789024012.070047:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296576 00000100:00100000:0.0:1789024012.070096:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:0.0:1789024012.070109:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402296448:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024012.070281:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402296448:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 174us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.070290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:0.0:1789024012.070316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:0.0:1789024012.070323:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402296576:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024012.070352:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402296576:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.070358:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:2.0:1789024012.071325:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.071419:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295808 00000100:00100000:1.0:1789024012.071431:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295808 00000100:00100000:1.0:1789024012.071482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296064 00000100:00100000:1.0:1789024012.071486:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296064 00000100:00100000:1.0:1789024012.071499:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789024012.071507:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875927402295808:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789024012.071552:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1333f43e-b74a-4ef6-9a10-e9b68b18678f@192.168.202.18@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1789024012.071623:0:6515:0:(genops.c:1384:class_connect()) connect: client 1333f43e-b74a-4ef6-9a10-e9b68b18678f, cookie 0xa736ef4b98cb373f 00000004:00100000:1.0:1789024012.071816:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789024012.072008:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90cb0259f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024012.072315:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2399:x1875927402295808:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 806us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.072327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789024012.072371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:1.0:1789024012.072379:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875927402296064:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789024012.072404:0:6515:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 1333f43e-b74a-4ef6-9a10-e9b68b18678f@192.168.202.18@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1789024012.072439:0:6515:0:(genops.c:1384:class_connect()) connect: client 1333f43e-b74a-4ef6-9a10-e9b68b18678f, cookie 0xa736ef4b98cb3746 00000004:00100000:1.0:1789024012.072484:0:6515:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789024012.072855:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90cb02599800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024012.072942:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2399:x1875927402296064:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 560us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.072955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:1.0:1789024012.080515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.080643:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.090723:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024012.099948:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296320 00000100:00100000:2.0:1789024012.099974:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296320 00000100:00100000:2.0:1789024012.100162:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296192 00000100:00100000:2.0:1789024012.100167:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296192 00000100:00100000:2.0:1789024012.100209:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:2.0:1789024012.100225:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402296320:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789024012.100292:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789024012.100449:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402296320:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 226us (19947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024012.100459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:2.0:1789024012.100482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:2.0:1789024012.100489:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:0:x1875927402296192:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789024012.100510:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024012.100551:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:0:x1875927402296192:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 63us (19918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024012.100572:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00080000:0.0:1789024012.101788:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024012.101800:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024012.101820:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402295936 00000100:00100000:0.0:1789024012.101829:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402295936 00000100:00100000:0.0:1789024012.101873:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:0.0:1789024012.101882:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:0:x1875927402295936:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789024012.101911:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024012.101989:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:0:x1875927402295936:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 107us (11282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.101996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:2.0:1789024012.105717:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024012.106180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296704 00000100:00100000:3.0:1789024012.106194:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296704 00000100:00100000:3.0:1789024012.106267:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024012.106281:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402296704:12345-192.168.202.18@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789024012.106420:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402296704:12345-192.168.202.18@tcp:40:mount.lustre.0 Request processed in 141us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.106430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00010000:00010000:1.0:1789024012.109650:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024012.114735:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024012.115026:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296832 00000100:00100000:0.0:1789024012.115061:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296832 00000100:00100000:0.0:1789024012.115143:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:0.0:1789024012.115206:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875927402296832:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789024012.115280:0:10202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1333f43e-b74a-4ef6-9a10-e9b68b18678f@192.168.202.18@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1789024012.115331:0:10202:0:(genops.c:1384:class_connect()) connect: client 1333f43e-b74a-4ef6-9a10-e9b68b18678f, cookie 0xa736ef4b98cb374d 00002000:00100000:0.0:1789024012.115349:0:10202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1333f43e-b74a-4ef6-9a10-e9b68b18678f/ffff90cb03958000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789024012.115366:0:10202:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789024012.115485:0:10202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789024012.115529:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cb0395e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024012.115648:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2399:x1875927402296832:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 442us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.115657:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:2.0:1789024012.116612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024012.116777:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402296960 00000100:00100000:1.0:1789024012.116788:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402296960 00000100:00100000:1.0:1789024012.116842:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:1.0:1789024012.116850:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875927402296960:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789024012.116889:0:8904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1333f43e-b74a-4ef6-9a10-e9b68b18678f@192.168.202.18@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1789024012.116926:0:8904:0:(genops.c:1384:class_connect()) connect: client 1333f43e-b74a-4ef6-9a10-e9b68b18678f, cookie 0xa736ef4b98cb3754 00002000:00100000:1.0:1789024012.116940:0:8904:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1333f43e-b74a-4ef6-9a10-e9b68b18678f/ffff90cb0259b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789024012.116962:0:8904:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789024012.117045:0:8904:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789024012.120813:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cb0259a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024012.121057:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2399:x1875927402296960:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 4200us (4447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.121073:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:2.0:1789024012.126581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024012.126880:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297088 00000100:00100000:0.0:1789024012.126896:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297088 00000100:00100000:0.0:1789024012.126981:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:0.0:1789024012.126994:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402297088:12345-192.168.202.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789024012.136767:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402297088:12345-192.168.202.18@tcp:900:mount.lustre.0 Request processed in 9751us (10188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.136791:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:2.0:1789024012.147793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024012.148142:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297216 00000100:00100000:3.0:1789024012.148188:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297216 00000100:00100000:3.0:1789024012.148263:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:3.0:1789024012.148275:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402297216:12345-192.168.202.18@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789024012.148443:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789024012.148720:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:8727:x1875927402297216:12345-192.168.202.18@tcp:33:mount.lustre.0 Request processed in 263us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.148731:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:1.0:1789024012.172980:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024012.173015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422289408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024012.173117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.173826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422289792:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.173876:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.173910:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422290304:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.173933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.173949:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422290816:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.173969:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.173993:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789024012.173999:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422289920:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.174029:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.174051:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422290432:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.174073:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.174089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422290944:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.174108:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024012.174170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289920 00000100:00100000:1.0:1789024012.174181:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289920 00000100:00100000:2.0:1789024012.174251:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289408 00000100:00100000:1.0:1789024012.174251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789024012.174267:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289408 00000100:00100000:1.0:1789024012.174267:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024012.174350:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789024012.174364:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422289408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024012.174389:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024012.174481:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422289408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024012.174489:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789024012.174502:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422289664:0@lo:400:kworker.0 00000100:00080000:2.0:1789024012.174532:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024012.174567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174610:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422290176:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.174764:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174790:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422290688:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.174815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174838:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789024012.174844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422289536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024012.174884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174901:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422290048:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.174921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174931:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.174949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.174969:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291072:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.174988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024012.175031:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290688 00000100:00100000:0.0:1789024012.175037:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290688 00000100:00100000:0.0:1789024012.175071:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290560 00000100:00100000:0.0:1789024012.175074:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290560 00000100:00100000:0.0:1789024012.175095:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291072 00000100:00100000:0.0:1789024012.175098:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291072 00000100:00100000:0.0:1789024012.175134:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789024012.175142:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422290688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.175221:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422290688:12345-0@lo:400:kworker.0 Request processed in 80us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.175228:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789024012.175246:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789024012.175252:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422290560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.175279:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422290560:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024012.175284:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789024012.175393:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289536 00000100:00100000:2.0:1789024012.175402:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289536 00000100:00100000:2.0:1789024012.175439:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789024012.175446:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422289536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024012.175461:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024012.175498:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789024012.175516:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024012.175528:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422289536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.175587:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422291072:12345-0@lo:400:kworker.0 Request processed in 77us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.175594:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789024012.175624:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289792 00000100:00100000:3.0:1789024012.175629:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289792 00000100:00100000:3.0:1789024012.175792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290304 00000100:00100000:3.0:1789024012.175797:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290304 00000100:00100000:3.0:1789024012.175812:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290816 00000100:00100000:3.0:1789024012.175815:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290816 00000100:00100000:3.0:1789024012.175828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290432 00000100:00100000:3.0:1789024012.175831:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290432 00000100:00100000:3.0:1789024012.175845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290944 00000100:00100000:3.0:1789024012.175847:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290944 00000100:00100000:3.0:1789024012.175859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290048 00000100:00100000:3.0:1789024012.175862:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290048 00000100:00100000:3.0:1789024012.175873:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789024012.175879:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422289792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024012.175916:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422289792:12345-0@lo:400:kworker.0 Request processed in 37us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.175922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789024012.175933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789024012.175939:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422290304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024012.175978:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422290304:12345-0@lo:400:kworker.0 Request processed in 40us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.175984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789024012.175994:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789024012.175999:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422290816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024012.176022:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422290816:12345-0@lo:400:kworker.0 Request processed in 24us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.176027:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789024012.176036:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789024012.176041:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422290432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024012.176067:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422290432:12345-0@lo:400:kworker.0 Request processed in 26us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.176072:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789024012.176083:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789024012.176098:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024012.176098:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789024012.176140:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024012.176190:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024012.176196:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422290944:12345-0@lo:400:kworker.0 Request processed in 105us (2083us total) trans 0 rc 0/0 00000100:00080000:2.0:1789024012.176199:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024012.176211:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789024012.176224:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422289664 00000100:00100000:2.0:1789024012.176232:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422289664 00000100:00100000:3.0:1789024012.176234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789024012.176242:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422290048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024012.176270:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422290048:12345-0@lo:400:kworker.0 Request processed in 29us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024012.176275:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789024012.176503:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422289920:12345-0@lo:400:kworker.0 Request processed in 2240us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.176512:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789024012.176541:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422290176 00000100:00100000:1.0:1789024012.176545:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422290176 00000100:00100000:1.0:1789024012.176773:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789024012.176780:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.176814:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422290176:12345-0@lo:400:kworker.0 Request processed in 36us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.176839:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789024012.176896:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789024012.176908:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.176933:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422289920:0@lo:400:kworker.0 00010000:00080000:1.0:1789024012.176956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974700 x1875927422290432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024012.176969:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422290432:0@lo:400:kworker.0 00010000:00080000:1.0:1789024012.176993:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc34602a00 x1875927422290944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024012.177002:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422289664:12345-0@lo:400:kworker.0 Request processed in 93us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024012.177022:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34602a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422290944:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.177038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422289792:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.177050:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422290304:0@lo:400:kworker.0 00000100:00100000:1.0:1789024012.177061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422290816:0@lo:400:kworker.0 00010000:00080000:1.0:1789024012.177074:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8f100 x1875927422289408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024012.177092:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422289408:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789024012.177446:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c5880 x1875927422289536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024012.177463:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422289536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024012.177492:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422290048:0@lo:400:kworker.0 00000100:00100000:2.0:1789024012.178132:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00080000:0.0:1789024012.178329:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f975c00 x1875927422290560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024012.178344:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422290560:0@lo:400:kworker.0 00010000:00080000:0.0:1789024012.178362:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0ff100 x1875927422291072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024012.178371:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291072:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.178382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422289664:0@lo:400:kworker.0 00000100:00100000:0.0:1789024012.178393:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422290176:0@lo:400:kworker.0 00010000:00080000:0.0:1789024012.178405:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974e00 x1875927422290688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024012.178414:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422290688:0@lo:400:kworker.0 00010000:00010000:0.0:1789024013.132611:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024013.709877:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024013.709990:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024013.710126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291200 00000100:00100000:0.0:1789024013.710135:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291200 00000100:00100000:0.0:1789024013.710238:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789024013.710250:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31366850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422291200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024013.710292:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024013.710354:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31366850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422291200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024013.710361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789024013.710952:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024014.160134:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024015.180458:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024015.756477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422291328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024015.756568:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024015.756685:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291328 00000100:00100000:1.0:1789024015.756694:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291328 00000100:00100000:1.0:1789024015.756749:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789024015.756760:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422291328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024015.756806:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024015.756854:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422291328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024015.756861:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789024015.756950:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422291328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024016.204447:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024016.780829:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024016.780829:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024016.780852:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422291456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024016.780864:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024016.792363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024016.792581:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291456 00000100:00100000:2.0:1789024016.792593:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291456 00000100:00100000:2.0:1789024016.792670:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789024016.792681:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422291456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024016.792732:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024016.792797:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422291456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024016.792805:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789024016.792847:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039e8380 x1875927422291456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024016.792868:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422291456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024016.793200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024016.793229:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291584 00000100:00100000:2.0:1789024016.793234:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291584 00000100:00100000:2.0:1789024016.793260:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789024016.793267:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422291584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024016.793278:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024016.793320:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422291584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024016.793327:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789024016.793396:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0ffb80 x1875927422291584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024016.793410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422291584:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789024016.793808:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789024017.231024:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024017.293261:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422292096:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.293389:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422292608:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.293442:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422293120:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.293487:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789024017.293493:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422291712:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.293542:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422292224:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293565:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.293581:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422292736:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.293600:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.295879:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422293248:0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.296882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024017.297234:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292096 00000100:00100000:3.0:1789024017.297244:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292096 00000100:00100000:3.0:1789024017.297299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789024017.297310:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422292096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.297386:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422292096:12345-0@lo:400:kworker.0 Request processed in 78us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024017.297402:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789024017.297430:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292608 00000100:00100000:3.0:1789024017.297434:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292608 00000100:00100000:3.0:1789024017.297464:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293120 00000100:00100000:3.0:1789024017.297467:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293120 00000100:00100000:3.0:1789024017.297494:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292736 00000100:00100000:3.0:1789024017.297498:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292736 00000100:00100000:3.0:1789024017.297512:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293248 00000100:00100000:3.0:1789024017.297515:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293248 00000100:00100000:3.0:1789024017.297532:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789024017.297539:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422292608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.297576:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422292608:12345-0@lo:400:kworker.0 Request processed in 38us (4159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024017.297581:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789024017.297594:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789024017.297601:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422293120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.297658:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422293120:12345-0@lo:400:kworker.0 Request processed in 57us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024017.297664:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789024017.297680:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789024017.297686:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422292736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.297720:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422292736:12345-0@lo:400:kworker.0 Request processed in 34us (4118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.297723:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291712 00000100:00100000:3.0:1789024017.297728:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789024017.297731:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291712 00000100:00100000:3.0:1789024017.297759:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789024017.297771:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789024017.297781:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422291712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.297817:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422291712:12345-0@lo:400:kworker.0 Request processed in 40us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.297823:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789024017.297865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292224 00000100:00100000:1.0:1789024017.297869:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292224 00000100:00100000:1.0:1789024017.297890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789024017.297895:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422292224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.297923:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422292224:12345-0@lo:400:kworker.0 Request processed in 27us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.297928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789024017.298049:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422291712:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298063:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422292224:0@lo:400:kworker.0 00010000:00080000:1.0:1789024017.298077:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fed80 x1875927422292736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.298087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422292736:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298096:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422292096:0@lo:400:kworker.0 00010000:00080000:1.0:1789024017.298113:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fce00 x1875927422292608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.298121:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422292608:0@lo:400:kworker.0 00010000:00080000:1.0:1789024017.298130:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bca80 x1875927422293120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.298137:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422293120:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298191:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422291840:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298221:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422292352:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298274:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422292864:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298305:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422293376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024017.298325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298343:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789024017.298349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422291968:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298369:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422292480:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422292992:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298431:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.298448:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291840 00000100:00100000:1.0:1789024017.298451:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291840 00000100:00100000:1.0:1789024017.298474:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292352 00000100:00100000:1.0:1789024017.298477:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292352 00000100:00100000:1.0:1789024017.298490:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292864 00000100:00100000:1.0:1789024017.298492:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292864 00000100:00100000:1.0:1789024017.298502:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292480 00000100:00100000:1.0:1789024017.298504:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292480 00000100:00100000:1.0:1789024017.298515:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422292992 00000100:00100000:1.0:1789024017.298518:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422292992 00000100:00100000:1.0:1789024017.298531:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789024017.298537:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298574:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422291840:12345-0@lo:400:kworker.0 Request processed in 37us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298580:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789024017.298596:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789024017.298602:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298643:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422292352:12345-0@lo:400:kworker.0 Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298648:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789024017.298659:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789024017.298665:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298689:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422292864:12345-0@lo:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298694:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789024017.298706:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789024017.298711:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298734:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422292480:12345-0@lo:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298747:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789024017.298759:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789024017.298764:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298789:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422292992:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298794:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789024017.298812:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422291968 00000100:00100000:1.0:1789024017.298815:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422291968 00000100:00100000:1.0:1789024017.298836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789024017.298842:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298869:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422291968:12345-0@lo:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.298874:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789024017.298907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422291968:0@lo:400:kworker.0 00010000:00080000:1.0:1789024017.298918:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fea00 x1875927422292480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.298928:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422292480:0@lo:400:kworker.0 00010000:00080000:1.0:1789024017.298936:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bdf80 x1875927422292992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.298945:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422292992:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422291840:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298964:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422292352:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.298972:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422292864:0@lo:400:kworker.0 00000100:00080000:1.0:1789024017.299108:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024017.299112:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024017.299115:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024017.299139:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293376 00000100:00100000:1.0:1789024017.299143:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293376 00000100:00100000:1.0:1789024017.299199:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789024017.299206:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422293376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024017.299226:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024017.299262:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422293376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.299268:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789024017.299293:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3be9f100 x1875927422293376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.299308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422293376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024017.299676:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024017.300185:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422293248:12345-0@lo:400:kworker.0 Request processed in 2417us (3308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024017.300194:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789024017.300376:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bfb80 x1875927422293248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024017.300389:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422293248:0@lo:400:kworker.0 00000100:00100000:1.0:1789024017.300428:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422293504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024017.300644:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024017.301036:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293504 00000100:00100000:1.0:1789024017.301043:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293504 00000100:00100000:1.0:1789024017.301085:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789024017.301093:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422293504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024017.301110:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024017.301181:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422293504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.301200:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789024017.304324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c7480 x1875927422293504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024017.304373:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422293504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024017.428016:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428080:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428112:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428131:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428186:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024017.428202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024017.436037:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297344 00000100:00100000:1.0:1789024017.436052:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297344 00000100:00100000:1.0:1789024017.436133:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 304 00000100:00100000:1.0:1789024017.436163:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402297344:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436245:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402297344:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 103us (8241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436253:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 304 00000100:00100000:1.0:1789024017.436294:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297600 00000100:00100000:1.0:1789024017.436298:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297600 00000100:00100000:1.0:1789024017.436328:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297856 00000100:00100000:1.0:1789024017.436332:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297856 00000100:00100000:1.0:1789024017.436349:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297472 00000100:00100000:1.0:1789024017.436352:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297472 00000100:00100000:1.0:1789024017.436365:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297728 00000100:00100000:1.0:1789024017.436368:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297728 00000100:00100000:1.0:1789024017.436381:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:1.0:1789024017.436387:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402297600:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436417:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402297600:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 29us (8336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436423:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:1.0:1789024017.436437:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:1.0:1789024017.436444:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297856:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436467:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297856:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 23us (8354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436473:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:1.0:1789024017.436500:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 141 00000100:00100000:1.0:1789024017.436506:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402297472:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436532:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402297472:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (8362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436538:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 141 00000100:00100000:1.0:1789024017.436552:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:1.0:1789024017.436559:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297728:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436583:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297728:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (8397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436589:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:1.0:1789024017.436624:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298112 00000100:00100000:1.0:1789024017.436628:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298112 00000100:00100000:1.0:1789024017.436654:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402297984 00000100:00100000:1.0:1789024017.436658:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402297984 00000100:00100000:1.0:1789024017.436679:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:1.0:1789024017.436686:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402298112:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436902:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402298112:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 215us (8768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436908:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:1.0:1789024017.436924:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:1.0:1789024017.436930:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297984:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024017.436954:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2403:x1875927402297984:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 24us (8751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024017.436959:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00080000:1.0:1789024017.438084:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789024017.438090:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789024017.438093:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024017.438221:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1789024017.826035:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00100000:3.0:1789024017.828572:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00100000:3.0:1789024017.829736:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00100000:0.0:1789024017.836892:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:02000400:2.0:1789024018.201503:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789024018.258030:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024018.828494:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024018.828519:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422293632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024018.828590:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024018.828950:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293632 00000100:00100000:0.0:1789024018.828960:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293632 00000100:00100000:0.0:1789024018.829015:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789024018.829025:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422293632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024018.829060:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024018.829116:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422293632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024018.829123:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789024018.829256:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422293632:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024019.276426:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024020.301739:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024020.876480:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422293760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024020.876568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024020.876997:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293760 00000100:00100000:0.0:1789024020.877006:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293760 00000100:00100000:0.0:1789024020.877062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789024020.877072:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422293760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024020.877106:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789024020.886881:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422293760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9795us (10297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024020.886900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789024020.888423:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422293760:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789024021.331014:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024021.900419:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422293888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024021.900510:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024021.900752:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422293888 00000100:00100000:3.0:1789024021.900761:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422293888 00000100:00100000:3.0:1789024021.900832:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789024021.900844:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422293888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024021.900883:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024021.900949:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422293888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024021.900956:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1789024021.901016:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021d1c00 x1875927422293888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024021.901035:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422293888:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789024021.901104:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024021.915447:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422294016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024021.915546:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024021.917113:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294016 00000100:00100000:3.0:1789024021.917128:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294016 00000100:00100000:3.0:1789024021.917217:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789024021.917227:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422294016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024021.917253:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789024021.923535:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024021.924302:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422294016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7070us (8749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024021.924316:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789024021.930848:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fd180 x1875927422294016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024021.931255:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422294016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789024022.350377:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024022.412588:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422294144:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412680:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.412728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422294656:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.412779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422295168:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412805:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.412826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422295680:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.412876:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789024022.412882:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422294272:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024022.412919:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422294528:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412930:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422294784:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.412964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.412991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422295296:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.413042:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294144 00000100:00100000:1.0:1789024022.413051:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294144 00000100:00100000:0.0:1789024022.413054:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.413485:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789024022.413496:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422294144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.421112:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422294400:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.423892:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422295808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024022.423975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024022.423991:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422295040:0@lo:400:kworker.0 00000100:00100000:0.0:1789024022.424084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024022.424131:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422295552:0@lo:400:kworker.0 00000100:00100000:3.0:1789024022.425733:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295808 00000100:00100000:3.0:1789024022.425748:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295808 00000100:00100000:3.0:1789024022.425822:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789024022.425836:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422295808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024022.425869:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789024022.434032:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024022.434430:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.441264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294656 00000100:00100000:1.0:1789024022.441279:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294656 00000100:00100000:2.0:1789024022.441463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024022.441529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422294912:0@lo:400:kworker.0 00000100:00100000:3.0:1789024022.441691:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422295808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15854us (17711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024022.441704:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789024022.441747:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294400 00000100:00100000:3.0:1789024022.441757:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294400 00000100:00100000:2.0:1789024022.441757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024022.441833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422295424:0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.441883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024022.441897:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422295936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024022.441922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024022.441975:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294272 00000100:00100000:2.0:1789024022.441983:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294272 00000100:00100000:2.0:1789024022.442038:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294784 00000100:00100000:2.0:1789024022.442042:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294784 00000100:00100000:1.0:1789024022.442059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789024022.442075:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422294656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.442078:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294528 00000100:00100000:2.0:1789024022.442084:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294528 00000100:00100000:2.0:1789024022.442100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422294912 00000100:00100000:2.0:1789024022.442104:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422294912 00000100:00100000:2.0:1789024022.442124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295424 00000100:00100000:2.0:1789024022.442128:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295424 00000100:00100000:1.0:1789024022.442179:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422294656:12345-0@lo:400:kworker.0 Request processed in 109us (29422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.442187:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789024022.442228:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295168 00000100:00100000:1.0:1789024022.442235:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295168 00000100:00100000:1.0:1789024022.442264:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295680 00000100:00100000:1.0:1789024022.442267:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295680 00000100:00100000:1.0:1789024022.442282:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295040 00000100:00100000:1.0:1789024022.442285:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295040 00000100:00100000:1.0:1789024022.442295:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295552 00000100:00100000:1.0:1789024022.442298:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295552 00000100:00100000:1.0:1789024022.442315:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789024022.442321:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.442356:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422295168:12345-0@lo:400:kworker.0 Request processed in 35us (29550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.442361:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789024022.442374:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789024022.442381:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.442409:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422295680:12345-0@lo:400:kworker.0 Request processed in 29us (29560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.442431:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789024022.442444:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789024022.442450:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422295040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.442481:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422295040:12345-0@lo:400:kworker.0 Request processed in 31us (18398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.442486:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789024022.442497:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789024022.442504:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.442531:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422295552:12345-0@lo:400:kworker.0 Request processed in 28us (8106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.442535:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789024022.442560:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789024022.443180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789024022.443264:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422294784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.443404:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422294784:12345-0@lo:400:kworker.0 Request processed in 146us (30427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.443413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789024022.443431:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789024022.443438:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422294528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.443470:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422294528:12345-0@lo:400:kworker.0 Request processed in 33us (30433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.443488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789024022.443500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789024022.443508:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422294912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024022.443773:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789024022.443784:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422294400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.443847:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422294912:12345-0@lo:400:kworker.0 Request processed in 324us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.443860:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.443878:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789024022.443916:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422294272:12345-0@lo:400:kworker.0 Request processed in 1347us (31006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.443933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789024022.443944:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422295424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.443985:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422295424:12345-0@lo:400:kworker.0 Request processed in 44us (2102us total) trans 0 rc 0/0 00010000:00080000:0.0:1789024022.444361:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ed80 x1875927422295552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024022.444404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422295552:0@lo:400:kworker.0 00000100:00100000:0.0:1789024022.444457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422294528:0@lo:400:kworker.0 00010000:00080000:0.0:1789024022.444471:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8f800 x1875927422295040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024022.444778:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422295040:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.446918:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789024022.447007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024022.447087:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422294656:0@lo:400:kworker.0 00010000:00080000:1.0:1789024022.447107:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8c700 x1875927422295168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024022.447118:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422295168:0@lo:400:kworker.0 00010000:00080000:1.0:1789024022.447131:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8f100 x1875927422295680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024022.447140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422295680:0@lo:400:kworker.0 00000100:00100000:3.0:1789024022.447355:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422294400:12345-0@lo:400:kworker.0 Request processed in 3570us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.451007:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422294272:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.451026:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422294784:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.451068:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295296 00000100:00100000:1.0:1789024022.451074:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295296 00000100:00100000:1.0:1789024022.451127:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789024022.451135:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422295296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.451243:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422295296:12345-0@lo:400:kworker.0 Request processed in 108us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.451252:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789024022.451481:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422295296:0@lo:400:kworker.0 00000100:00100000:1.0:1789024022.451526:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422294144:12345-0@lo:400:kworker.0 Request processed in 38031us (38846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024022.451534:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789024022.451564:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422294144:0@lo:400:kworker.0 00000100:00100000:2.0:1789024022.451693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789024022.451713:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789024022.451754:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024022.451765:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024022.451770:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024022.451772:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422295936 00000100:00100000:3.0:1789024022.451779:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422295936 00000100:00100000:3.0:1789024022.451825:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789024022.451833:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422295936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024022.451847:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422294400:0@lo:400:kworker.0 00002000:00000024:3.0:1789024022.451854:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1789024022.451874:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3be9f100 x1875927422294912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024022.451904:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422294912:0@lo:400:kworker.0 00000100:00100000:3.0:1789024022.451911:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422295936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (9981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024022.451922:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789024022.451935:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8e680 x1875927422295424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024022.451947:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422295424:0@lo:400:kworker.0 00010000:00080000:2.0:1789024022.451965:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021d1c00 x1875927422295936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024022.451985:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422295936:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789024022.451994:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c4700 x1875927422295808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024022.452019:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422295808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024022.550036:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024022.550114:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298240 00000100:00100000:2.0:1789024022.550125:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298240 00000100:00100000:2.0:1789024022.550206:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 306 00000100:00100000:2.0:1789024022.550217:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402298240:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024022.550299:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402298240:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.550307:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 306 00000100:00100000:1.0:1789024022.566444:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024022.568255:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298368 00000100:00100000:2.0:1789024022.568270:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298368 00000100:00100000:2.0:1789024022.568395:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00100000:2.0:1789024022.568407:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402298368:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024022.568484:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402298368:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 80us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.568492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00080000:0.0:1789024022.580386:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024022.580702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024022.580732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024022.580795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024022.580814:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024022.580839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024022.580888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298624 00000100:00100000:0.0:1789024022.580899:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298624 00000100:00100000:0.0:1789024022.580950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298496 00000100:00100000:0.0:1789024022.580953:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298496 00000100:00100000:0.0:1789024022.580984:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298752 00000100:00100000:0.0:1789024022.580986:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298752 00000100:00100000:0.0:1789024022.581002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:0.0:1789024022.581010:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298624:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024022.581077:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298624:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024022.581085:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:0.0:1789024022.581102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00100000:0.0:1789024022.581108:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402298496:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024022.581127:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402298496:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 20us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024022.581133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00100000:0.0:1789024022.581142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 152 00000100:00100000:0.0:1789024022.581166:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298752:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024022.581189:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298752:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024022.581195:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 152 00000100:00080000:0.0:1789024022.581213:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024022.581215:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024022.606271:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402298880 00000100:00100000:2.0:1789024022.606288:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402298880 00000100:00080000:1.0:1789024022.606364:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024022.606394:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299008 00000100:00100000:2.0:1789024022.606399:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299008 00000100:00100000:2.0:1789024022.606440:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00080000:1.0:1789024022.606445:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024022.606452:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298880:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024022.606552:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402298880:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 103us (25818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.606562:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:2.0:1789024022.606592:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:2.0:1789024022.606600:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402299008:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024022.606629:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402299008:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (25789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024022.606635:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 50 00010000:00010000:0.0:1789024023.373976:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024023.948944:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024023.949020:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024023.949173:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296064 00000100:00100000:3.0:1789024023.949183:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296064 00000100:00100000:3.0:1789024023.949245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789024023.949255:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024023.949292:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789024023.949882:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 627us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024023.949891:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789024023.950011:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024024.396378:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024025.420451:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024025.996377:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422296192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024025.996464:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024025.996592:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296192 00000100:00100000:3.0:1789024025.996602:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296192 00000100:00100000:3.0:1789024025.996663:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789024025.996674:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422296192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024025.996709:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024026.002968:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422296192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6285us (6493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024026.003000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789024026.011714:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422296192:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024026.445133:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024027.020435:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422296320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024027.020519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024027.020610:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296320 00000100:00100000:1.0:1789024027.020619:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296320 00000100:00100000:1.0:1789024027.020674:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789024027.020684:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422296320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024027.020712:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024027.020754:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422296320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024027.020760:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789024027.020790:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789024027.020821:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974e00 x1875927422296320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024027.020853:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422296320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024027.025113:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024027.025135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024027.025219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024027.025280:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296448 00000100:00100000:0.0:1789024027.025288:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296448 00000100:00100000:0.0:1789024027.025345:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789024027.025364:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789024027.025385:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024027.025431:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024027.025437:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789024027.025475:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039e8380 x1875927422296448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024027.025495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789024027.025578:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1789024027.377810:0:12505:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789024027.378358:0:12505:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789024027.484210:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024027.535289:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024027.535368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.535448:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296576 00000100:00100000:3.0:1789024027.535456:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296576 00000100:00100000:3.0:1789024027.535512:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789024027.535533:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024027.535564:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024027.535609:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422296576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.535615:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789024027.535821:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789024027.535865:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021d1c00 x1875927422296576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024027.535887:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422296576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024027.536562:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422296704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024027.536600:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024027.536680:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296704 00000100:00100000:2.0:1789024027.536694:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296704 00000100:00100000:2.0:1789024027.536738:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789024027.536746:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422296704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024027.536760:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024027.536795:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422296704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024027.536815:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789024027.536939:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789024027.536966:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a1500 x1875927422296704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024027.536980:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422296704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024027.537785:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422296832:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.537825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.537872:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422297344:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.537907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.537928:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422297856:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.537950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.537974:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789024027.537979:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422297216:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538011:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538029:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422297728:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297344 00000100:00100000:3.0:1789024027.538081:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297344 00000100:00100000:3.0:1789024027.538120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789024027.538127:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422297344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538200:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422297344:12345-0@lo:400:kworker.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.538207:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789024027.538231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297856 00000100:00100000:3.0:1789024027.538235:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297856 00000100:00100000:3.0:1789024027.538266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297216 00000100:00100000:3.0:1789024027.538268:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297216 00000100:00100000:3.0:1789024027.538279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297728 00000100:00100000:3.0:1789024027.538281:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297728 00000100:00100000:3.0:1789024027.538293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789024027.538298:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422297856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538331:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422297856:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.538336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789024027.538349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789024027.538363:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422297216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538395:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422297216:12345-0@lo:400:kworker.0 Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.538401:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789024027.538412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789024027.538418:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422297728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538442:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422297728:12345-0@lo:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.538447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789024027.538474:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422296960:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538516:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422297472:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538570:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789024027.538576:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422297088:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538612:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422297600:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.538630:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024027.538653:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297088 00000100:00100000:3.0:1789024027.538656:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297088 00000100:00100000:3.0:1789024027.538677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789024027.538683:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539065:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422297088:12345-0@lo:400:kworker.0 Request processed in 382us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.539072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789024027.539097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296960 00000100:00100000:3.0:1789024027.539101:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296960 00000100:00100000:3.0:1789024027.539114:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297472 00000100:00100000:3.0:1789024027.539116:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297472 00000100:00100000:3.0:1789024027.539126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297600 00000100:00100000:3.0:1789024027.539128:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297600 00000100:00100000:3.0:1789024027.539139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789024027.539163:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422296960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539195:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422296960:12345-0@lo:400:kworker.0 Request processed in 50us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.539200:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789024027.539213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024027.539220:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422297472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539244:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422297472:12345-0@lo:400:kworker.0 Request processed in 26us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.539249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024027.539260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789024027.539265:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422297600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539286:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422297600:12345-0@lo:400:kworker.0 Request processed in 22us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.539291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789024027.539306:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024027.539310:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024027.539340:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422297088:0@lo:400:kworker.0 00010000:00080000:3.0:1789024027.539350:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02603b80 x1875927422297600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024027.539359:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422297600:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422296960:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539384:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422297472:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539428:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422297216:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539437:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422297728:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.539446:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422297344:0@lo:400:kworker.0 00010000:00080000:3.0:1789024027.539455:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02602d80 x1875927422297856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024027.539462:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422297856:0@lo:400:kworker.0 00000100:00100000:2.0:1789024027.539648:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422296832 00000100:00100000:2.0:1789024027.539653:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422296832 00000100:00100000:2.0:1789024027.539701:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789024027.539709:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422296832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024027.539750:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422296832:12345-0@lo:400:kworker.0 Request processed in 43us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024027.539756:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789024027.539792:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422296832:0@lo:400:kworker.0 00000100:00100000:3.0:1789024027.674691:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674763:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674779:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674840:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024027.674878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299392 00000100:00100000:3.0:1789024027.674886:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299392 00000100:00100000:3.0:1789024027.674938:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299648 00000100:00100000:3.0:1789024027.674941:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299648 00000100:00100000:3.0:1789024027.674953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299264 00000100:00100000:3.0:1789024027.674955:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299264 00000100:00100000:3.0:1789024027.674965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299520 00000100:00100000:3.0:1789024027.674967:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299520 00000100:00100000:3.0:1789024027.674982:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 159 00000100:00100000:3.0:1789024027.674991:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402299392:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675083:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402299392:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 159 00000100:00100000:3.0:1789024027.675109:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 160 00000100:00100000:3.0:1789024027.675116:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299648:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675141:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299648:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 160 00000100:00100000:3.0:1789024027.675179:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 161 00000100:00100000:3.0:1789024027.675186:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402299264:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675211:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402299264:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 161 00000100:00100000:3.0:1789024027.675229:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 162 00000100:00100000:3.0:1789024027.675236:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299520:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675257:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299520:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 162 00000100:00100000:3.0:1789024027.675290:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299904 00000100:00100000:3.0:1789024027.675294:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299904 00000100:00100000:3.0:1789024027.675329:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299776 00000100:00100000:3.0:1789024027.675332:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299776 00000100:00100000:3.0:1789024027.675354:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:3.0:1789024027.675361:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299904:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675398:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299904:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 37us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675404:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:3.0:1789024027.675415:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:3.0:1789024027.675421:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299776:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024027.675439:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402299776:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 19us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024027.675444:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00080000:3.0:1789024027.675457:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789024027.675461:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789024027.675464:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024027.675466:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024027.680564:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402299136 00000100:00100000:1.0:1789024027.680580:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402299136 00000100:00100000:1.0:1789024027.681122:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 308 00000100:00100000:1.0:1789024027.681134:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402299136:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024027.681237:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402299136:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 105us (6559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024027.681245:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 308 00010000:00010000:1.0:1789024028.492403:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024029.080057:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422297984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024029.080143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024029.080238:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422297984 00000100:00100000:0.0:1789024029.080247:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422297984 00000100:00100000:0.0:1789024029.080297:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789024029.080306:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422297984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024029.080344:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024029.080391:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422297984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024029.080398:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789024029.080449:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422297984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024029.516455:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789024029.899649:0:12603:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024029.900016:0:12603:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789024030.541379:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024031.119140:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422298112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024031.119254:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024031.120824:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298112 00000100:00100000:1.0:1789024031.120834:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298112 00000100:00100000:1.0:1789024031.120908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789024031.120918:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422298112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024031.120960:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024031.121037:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422298112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024031.121045:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789024031.121312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422298112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789024031.564301:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024032.140536:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789024032.140567:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422298240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024032.140640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.140733:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298240 00000100:00100000:3.0:1789024032.140742:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298240 00000100:00100000:3.0:1789024032.140821:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789024032.140839:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422298240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024032.140868:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024032.140913:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422298240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.140919:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789024032.140956:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0700 x1875927422298240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.140975:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422298240:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789024032.141606:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024032.141702:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024032.141715:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422298368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024032.141776:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024032.141951:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298368 00000100:00100000:1.0:1789024032.141957:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298368 00000100:00100000:1.0:1789024032.142012:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789024032.142020:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422298368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024032.142035:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024032.142078:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422298368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.142085:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789024032.142126:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600a80 x1875927422298368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024032.142140:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422298368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789024032.142273:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1789024032.431274:0:12700:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789024032.433029:0:12700:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789024032.589275:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024032.656436:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422299008:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656610:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656630:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422299520:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656652:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656680:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789024032.656686:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656708:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422299136:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656763:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422299648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.656817:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422298752:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.656840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.657008:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422299264:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.657035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.657094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422299776:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.657113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.657131:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789024032.657136:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422298880:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.657177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.675629:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422299392:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.675699:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024032.676556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299520 00000100:00100000:1.0:1789024032.676571:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299520 00000100:00100000:1.0:1789024032.676643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298624 00000100:00100000:1.0:1789024032.676647:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298624 00000100:00100000:1.0:1789024032.676661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299136 00000100:00100000:1.0:1789024032.676664:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299136 00000100:00100000:1.0:1789024032.676676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299264 00000100:00100000:1.0:1789024032.676678:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299264 00000100:00100000:1.0:1789024032.676688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298880 00000100:00100000:1.0:1789024032.676691:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298880 00000100:00100000:1.0:1789024032.676708:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789024032.676727:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.676804:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422299520:12345-0@lo:400:kworker.0 Request processed in 78us (20151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.676811:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789024032.676839:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789024032.676846:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422298624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.676886:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422298624:12345-0@lo:400:kworker.0 Request processed in 41us (20177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.676893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789024032.676906:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789024032.676912:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422299136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.676938:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422299136:12345-0@lo:400:kworker.0 Request processed in 27us (20192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.676944:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789024032.676956:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789024032.676961:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422299264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.676989:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422299264:12345-0@lo:400:kworker.0 Request processed in 29us (19953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.676996:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789024032.677007:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789024032.677012:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422298880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.677036:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422298880:12345-0@lo:400:kworker.0 Request processed in 24us (19858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.677040:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789024032.683763:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298496 00000100:00100000:1.0:1789024032.683790:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298496 00000100:00100000:1.0:1789024032.683952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789024032.683964:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422298496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.684070:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422298496:12345-0@lo:400:kworker.0 Request processed in 108us (27534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.684077:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789024032.684124:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299008 00000100:00100000:1.0:1789024032.684129:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299008 00000100:00100000:1.0:1789024032.684173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422298752 00000100:00100000:1.0:1789024032.684176:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422298752 00000100:00100000:1.0:1789024032.684189:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024032.684194:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422299008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.684228:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422299008:12345-0@lo:400:kworker.0 Request processed in 33us (27617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.684233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024032.684246:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024032.684252:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422298752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024032.684279:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422298752:12345-0@lo:400:kworker.0 Request processed in 28us (27438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.684285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789024032.684426:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024032.684431:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024032.684771:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422299904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024032.684819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.684869:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422298752:0@lo:400:kworker.0 00010000:00080000:3.0:1789024032.684887:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90c700 x1875927422299264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.684897:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422299264:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.684926:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422298880:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.684952:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299648 00000100:00100000:3.0:1789024032.684957:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299648 00000100:00100000:3.0:1789024032.684995:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299776 00000100:00100000:3.0:1789024032.684999:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299776 00000100:00100000:3.0:1789024032.685017:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789024032.685023:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422299648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685059:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422299648:12345-0@lo:400:kworker.0 Request processed in 36us (28272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.685064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789024032.685078:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789024032.685083:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685113:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422299776:12345-0@lo:400:kworker.0 Request processed in 30us (27998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.685119:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789024032.685170:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422300032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024032.685196:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024032.685225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422298624:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685238:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422299136:0@lo:400:kworker.0 00010000:00080000:3.0:1789024032.685258:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90ed80 x1875927422299648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.685266:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422299648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685274:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422298496:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422299008:0@lo:400:kworker.0 00010000:00080000:3.0:1789024032.685294:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90dc00 x1875927422299520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.685302:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422299520:0@lo:400:kworker.0 00000100:00100000:3.0:1789024032.685336:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299904 00000100:00100000:3.0:1789024032.685340:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299904 00000100:00100000:3.0:1789024032.685362:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300032 00000100:00100000:3.0:1789024032.685365:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300032 00000100:00100000:3.0:1789024032.685378:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789024032.685384:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422299904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024032.685406:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024032.685438:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422299904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.685444:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789024032.685455:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789024032.685461:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422300032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024032.685482:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024032.685513:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422300032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.685519:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789024032.685539:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789024032.685563:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f975c00 x1875927422299904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.685579:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422299904:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789024032.685589:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90d180 x1875927422299776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.685597:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422299776:0@lo:400:kworker.0 00010000:00080000:3.0:1789024032.685626:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02601180 x1875927422300032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024032.685637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422300032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024032.685813:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422299392 00000100:00100000:2.0:1789024032.685819:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422299392 00000100:00100000:2.0:1789024032.685872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789024032.685880:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422299392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024032.685920:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422299392:12345-0@lo:400:kworker.0 Request processed in 41us (10221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024032.685925:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1789024032.686063:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024032.686084:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422299392:0@lo:400:kworker.0 00000100:00100000:2.0:1789024032.790668:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024032.790712:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024032.790823:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024032.790864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300160 00000100:00100000:2.0:1789024032.790873:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300160 00000100:00100000:2.0:1789024032.790930:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300288 00000100:00100000:2.0:1789024032.790934:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300288 00000100:00100000:2.0:1789024032.790959:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 169 00000100:00100000:2.0:1789024032.790969:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402300160:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024032.791042:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402300160:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024032.791050:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 169 00000100:00100000:2.0:1789024032.791068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 170 00000100:00100000:2.0:1789024032.791074:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402300288:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024032.791099:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402300288:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024032.791105:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 170 00000100:00080000:2.0:1789024032.791121:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024032.791124:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024032.793391:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300032 00000100:00100000:3.0:1789024032.793405:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300032 00000100:00100000:1.0:1789024032.793647:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024032.793676:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024032.793699:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024032.793726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024032.793759:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300672 00000100:00100000:1.0:1789024032.793763:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300672 00000100:00100000:1.0:1789024032.793812:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300800 00000100:00100000:1.0:1789024032.793815:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300800 00000100:00100000:1.0:1789024032.793878:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:1.0:1789024032.793888:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2399:x1875927402300672:12345-192.168.202.18@tcp:9:kworker.0 00000020:00000080:1.0:1789024032.793922:0:10202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb374d 00000100:00080000:1.0:1789024032.793930:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cb0395e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789024032.793976:0:10202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789024032.794184:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+2:2399:x1875927402300672:12345-192.168.202.18@tcp:9:kworker.0 Request processed in 296us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.794192:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:1.0:1789024032.794223:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:1.0:1789024032.794231:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2399:x1875927402300800:12345-192.168.202.18@tcp:9:kworker.0 00000020:00000080:1.0:1789024032.794247:0:10202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3754 00000100:00080000:1.0:1789024032.794253:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cb0259a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789024032.794280:0:10202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789024032.794358:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+2:2399:x1875927402300800:12345-192.168.202.18@tcp:9:kworker.0 Request processed in 129us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024032.794365:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:3.0:1789024032.795005:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 310 00000100:00100000:3.0:1789024032.795017:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402300032:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024032.795054:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402300032:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 41us (4397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024032.795061:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 310 00010000:00010000:3.0:1789024032.795108:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024032.796690:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024032.796712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300416 00000100:00100000:2.0:1789024032.796722:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300416 00000100:00100000:0.0:1789024032.796968:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300544 00000100:00100000:0.0:1789024032.796974:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300544 00000100:00100000:0.0:1789024032.797025:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 171 00000100:00100000:0.0:1789024032.797035:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402300544:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024032.797101:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402300544:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 69us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024032.797108:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 171 00000100:00080000:0.0:1789024032.797184:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024032.797188:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024032.797191:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789024032.797194:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024032.801688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 172 00000100:00100000:2.0:1789024032.801709:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402300416:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024032.801805:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402300416:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 105us (8162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024032.801814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 172 00010000:00010000:0.0:1789024033.612638:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024034.188766:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422300160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024034.188883:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024034.189610:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300160 00000100:00100000:1.0:1789024034.189623:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300160 00000100:00100000:1.0:1789024034.189683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789024034.189692:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422300160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024034.189731:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024034.189792:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422300160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024034.189797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789024034.189951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422300160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024034.642124:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789024035.637349:0:12797:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789024035.638708:0:12797:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789024035.663398:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024036.237776:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422300288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024036.237871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024036.238135:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300288 00000100:00100000:2.0:1789024036.238171:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300288 00000100:00100000:2.0:1789024036.238217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789024036.238227:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422300288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024036.238263:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024036.238494:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422300288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 268us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024036.238501:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789024036.238595:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02601500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422300288:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024036.684626:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024037.266856:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024037.266881:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422300416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024037.266956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024037.267020:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300416 00000100:00100000:2.0:1789024037.267028:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300416 00000100:00100000:2.0:1789024037.267081:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789024037.267091:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422300416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024037.267121:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024037.267182:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422300416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024037.267189:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789024037.267210:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789024037.267239:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600e00 x1875927422300416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024037.267257:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422300416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024037.272737:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024037.272762:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422300544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789024037.272852:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024037.272911:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300544 00000100:00100000:2.0:1789024037.272919:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300544 00000100:00100000:2.0:1789024037.272984:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789024037.272995:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422300544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024037.273019:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024037.273066:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422300544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024037.273073:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789024037.273095:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789024037.273125:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02600e00 x1875927422300544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024037.273170:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422300544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789024037.712966:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024037.772373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422300672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024037.775208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422300800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024037.775301:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.775395:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300800 00000100:00100000:1.0:1789024037.775403:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300800 00000100:00100000:1.0:1789024037.775581:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789024037.775591:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422300800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024037.775623:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024037.775667:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422300800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.775674:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789024037.775704:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789024037.775738:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f976680 x1875927422300800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024037.775760:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422300800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024037.776253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776630:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422301184:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.776663:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776692:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422301696:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.776716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776732:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789024037.776738:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422301056:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.776757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776846:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422301568:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.776872:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776891:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422302080:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.776912:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024037.776948:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301696 00000100:00100000:3.0:1789024037.776954:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301696 00000100:00100000:3.0:1789024037.776997:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301056 00000100:00100000:3.0:1789024037.777000:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301056 00000100:00100000:3.0:1789024037.777012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301568 00000100:00100000:3.0:1789024037.777014:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301568 00000100:00100000:3.0:1789024037.777029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789024037.777036:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422301696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.777084:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422301696:12345-0@lo:400:kworker.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024037.777090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789024037.777123:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789024037.777128:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.777179:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422301056:12345-0@lo:400:kworker.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024037.777185:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789024037.777196:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789024037.777201:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422301568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024037.777209:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302080 00000100:00100000:2.0:1789024037.777213:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302080 00000100:00100000:3.0:1789024037.777229:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422301568:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024037.777234:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789024037.777239:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789024037.777246:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422302080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024037.777503:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301184 00000100:00100000:0.0:1789024037.777508:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301184 00000100:00100000:0.0:1789024037.777534:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789024037.777540:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422301184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024037.777574:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422301184:12345-0@lo:400:kworker.0 Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024037.777580:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789024037.777673:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300672 00000100:00100000:1.0:1789024037.777677:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300672 00000100:00100000:1.0:1789024037.777711:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789024037.777717:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422300672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024037.777730:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024037.777759:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422300672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.777764:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789024037.777861:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422300928:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.777893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.777914:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422301440:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.777934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.777963:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422301952:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.777985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.778003:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789024037.778009:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422301312:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.778026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.778038:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422301824:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.778053:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024037.778072:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301440 00000100:00100000:1.0:1789024037.778075:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301440 00000100:00100000:1.0:1789024037.778095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789024037.778101:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422301440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.778134:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422301440:12345-0@lo:400:kworker.0 Request processed in 33us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.778140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789024037.778180:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301952 00000100:00100000:1.0:1789024037.778184:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301952 00000100:00100000:1.0:1789024037.778199:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301312 00000100:00100000:1.0:1789024037.778200:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301312 00000100:00100000:1.0:1789024037.778209:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422301824 00000100:00100000:1.0:1789024037.778211:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422301824 00000100:00100000:1.0:1789024037.778222:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789024037.778227:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422301952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.778254:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422301952:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024037.778517:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422300928 00000100:00100000:0.0:1789024037.778522:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422300928 00000100:00100000:0.0:1789024037.778551:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789024037.778564:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422300928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024037.778593:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422300928:12345-0@lo:400:kworker.0 Request processed in 30us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024037.778599:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789024037.779112:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422301056:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.779133:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422301568:0@lo:400:kworker.0 00000100:00100000:3.0:1789024037.779155:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422301184:0@lo:400:kworker.0 00010000:00080000:3.0:1789024037.779167:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fe300 x1875927422301696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024037.779178:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422301696:0@lo:400:kworker.0 00010000:00080000:3.0:1789024037.779189:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f90dc00 x1875927422300672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024037.779202:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422300672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024037.779519:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789024037.779525:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422302080:12345-0@lo:400:kworker.0 Request processed in 2278us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024037.779534:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789024037.779545:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789024037.779553:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422301312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024037.779557:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789024037.779565:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422301824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024037.779596:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422301824:12345-0@lo:400:kworker.0 Request processed in 32us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.779596:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422301312:12345-0@lo:400:kworker.0 Request processed in 46us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024037.779602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:3.0:1789024037.779640:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039e8700 x1875927422302080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024037.779650:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422302080:0@lo:400:kworker.0 00000100:00080000:0.0:1789024037.781329:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789024037.781338:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024037.781341:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024037.783882:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789024037.783992:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422301312:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.784007:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422301824:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.784017:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422300928:0@lo:400:kworker.0 00000100:00100000:1.0:1789024037.784029:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422301440:0@lo:400:kworker.0 00010000:00080000:1.0:1789024037.784045:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb039eb800 x1875927422301952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024037.784056:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422301952:0@lo:400:kworker.0 00000100:00100000:2.0:1789024037.909117:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024037.909179:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024037.909213:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024037.909222:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301056 00000100:00100000:1.0:1789024037.909233:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301056 00000100:00100000:2.0:1789024037.909238:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024037.909294:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301312 00000100:00100000:1.0:1789024037.909298:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301312 00000100:00100000:1.0:1789024037.909310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301184 00000100:00100000:1.0:1789024037.909313:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301184 00000100:00100000:1.0:1789024037.909343:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 179 00000100:00100000:1.0:1789024037.909355:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402301056:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024037.909451:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 180 00000100:00100000:3.0:1789024037.909462:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301312:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024037.909501:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024037.911728:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402301056:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 2364us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.911745:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 179 00000100:00100000:1.0:1789024037.913283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301440 00000100:00100000:1.0:1789024037.913298:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301440 00000100:00100000:1.0:1789024037.913502:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:1.0:1789024037.913526:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402301184:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024037.913595:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402301184:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 73us (4358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.913603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:1.0:1789024037.913627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:1.0:1789024037.913633:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301440:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024037.913659:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301440:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (4159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.913665:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:1.0:1789024037.913696:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402300928 00000100:00100000:1.0:1789024037.913701:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402300928 00000100:00100000:1.0:1789024037.913729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 312 00000100:00100000:1.0:1789024037.913735:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402300928:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024037.913764:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402300928:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024037.913781:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 312 00000100:00080000:1.0:1789024037.913811:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024037.913817:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024037.920942:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301312:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 11465us (11744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024037.920961:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 180 00000020:00000004:1.0:1789024038.249920:0:12895:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024038.252551:0:12895:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789024038.732455:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789024038.802479:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000020:00000080:2.0:1789024038.802489:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cb03958000/1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000020:00000080:3.0:1789024038.802640:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb03958000/1333f43e-b74a-4ef6-9a10-e9b68b18678f for lustre-OST0000 00000020:00000080:3.0:1789024038.802696:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb0395e800 for lustre-OST0000 00000001:00100000:3.0:1789024038.803427:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000020:00000080:3.0:1789024038.803432:0:9511:0:(genops.c:885:class_export_put()) final put ffff90cb0259b800/1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000020:00000080:3.0:1789024038.803454:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0259b800/1333f43e-b74a-4ef6-9a10-e9b68b18678f for lustre-OST0001 00000020:00000080:3.0:1789024038.803489:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb0259a800 for lustre-OST0001 00000100:00100000:3.0:1789024039.308273:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024039.308296:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422302208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024039.308359:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024039.311687:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302208 00000100:00100000:1.0:1789024039.311702:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302208 00000100:00100000:1.0:1789024039.311771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789024039.311781:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422302208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024039.311816:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024039.311916:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422302208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024039.311923:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789024039.311988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422302208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024039.762777:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024040.780957:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024041.360165:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024041.360288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024041.360429:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302336 00000100:00100000:3.0:1789024041.360441:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302336 00000100:00100000:3.0:1789024041.360506:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789024041.362345:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024041.362413:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024041.362533:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2016us (2244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024041.362542:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789024041.362633:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302336:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024041.804368:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024042.380800:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024042.381301:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024042.381342:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422302592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024042.381478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.382047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302592 00000100:00100000:3.0:1789024042.382060:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302592 00000100:00080000:1.0:1789024042.382123:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024042.382139:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789024042.382180:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422302592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024042.382212:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024042.382292:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422302592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (815us total) trans 0 rc 0/0 00010000:00080000:1.0:1789024042.382447:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0e00 x1875927422302592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024042.382468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422302592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024042.383561:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024042.383622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024042.383977:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302464 00000100:00100000:0.0:1789024042.383985:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302464 00000100:00100000:0.0:1789024042.384049:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789024042.384058:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024042.384084:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024042.384183:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024042.384190:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789024042.384271:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789024042.384292:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb02603b80 x1875927422302464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024042.384415:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789024042.384454:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb02603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789024042.828573:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024042.893535:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422302720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024042.893645:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024042.896525:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302720 00000100:00100000:1.0:1789024042.896548:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302720 00000100:00100000:1.0:1789024042.896633:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789024042.896645:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422302720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024042.896686:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024042.901520:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422302720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4856us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024042.901539:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789024042.901597:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024042.901746:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024042.901823:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024042.901973:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302848 00000100:00100000:1.0:1789024042.901985:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302848 00000100:00100000:1.0:1789024042.902060:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789024042.902071:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024042.902104:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024042.902186:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422302848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024042.902193:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789024042.902215:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789024042.902253:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3d4a0e00 x1875927422302848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024042.902276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422302848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024042.904824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.904941:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.904986:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422303616:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905010:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905033:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789024042.905040:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422303232:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422303744:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905140:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303104 00000100:00100000:3.0:1789024042.905168:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303104 00000100:00100000:3.0:1789024042.905227:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303616 00000100:00100000:3.0:1789024042.905230:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303616 00000100:00100000:3.0:1789024042.905254:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303744 00000100:00100000:3.0:1789024042.905257:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303744 00000100:00100000:3.0:1789024042.905276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789024042.905284:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422303104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905343:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422303104:12345-0@lo:400:kworker.0 Request processed in 59us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.905356:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789024042.905385:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789024042.905391:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422303616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905421:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422303616:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.905427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789024042.905439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789024042.905444:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422303744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905469:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422303744:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.905475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789024042.905498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303232 00000100:00100000:3.0:1789024042.905503:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303232 00000100:00100000:3.0:1789024042.905528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789024042.905534:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422303232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905568:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422303232:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.905574:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789024042.905621:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422303232:0@lo:400:kworker.0 00010000:00080000:3.0:1789024042.905634:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0ff480 x1875927422303744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024042.905645:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422303744:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905655:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422303104:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905663:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422303616:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905703:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422302976:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905765:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422303488:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905802:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422304000:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905821:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789024042.905842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422303360:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905859:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905873:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422303872:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024042.905916:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422302976 00000100:00100000:3.0:1789024042.905920:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422302976 00000100:00100000:3.0:1789024042.905947:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789024042.905954:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422302976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.905987:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422302976:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.905995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789024042.906020:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303488 00000100:00100000:3.0:1789024042.906024:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303488 00000100:00100000:3.0:1789024042.906047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789024042.906052:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422303488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906078:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422303488:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.906084:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789024042.906109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304000 00000100:00100000:3.0:1789024042.906113:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304000 00000100:00100000:3.0:1789024042.906133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303360 00000100:00100000:3.0:1789024042.906136:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303360 00000100:00100000:3.0:1789024042.906172:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422303872 00000100:00100000:3.0:1789024042.906176:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422303872 00000100:00100000:3.0:1789024042.906190:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789024042.906195:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422304000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906228:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422304000:12345-0@lo:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.906234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789024042.906245:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789024042.906251:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422303360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906276:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422303360:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.906281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789024042.906290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789024042.906296:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422303872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906318:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422303872:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024042.906322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1789024042.906340:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024042.906345:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024042.906365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422303360:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906389:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422303872:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906398:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422302976:0@lo:400:kworker.0 00000100:00100000:3.0:1789024042.906415:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422303488:0@lo:400:kworker.0 00010000:00080000:3.0:1789024042.906426:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0ffb80 x1875927422304000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024042.906435:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422304000:0@lo:400:kworker.0 00010000:00080000:0.0:1789024042.907870:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3c025500 x1875927422302720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024042.907900:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422302720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024043.038820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024043.039914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024043.039947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024043.039970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024043.040000:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024043.040605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301824 00000100:00100000:0.0:1789024043.040619:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301824 00000100:00100000:0.0:1789024043.040699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302080 00000100:00100000:0.0:1789024043.040703:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302080 00000100:00100000:0.0:1789024043.040720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301696 00000100:00100000:0.0:1789024043.040859:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301696 00000100:00100000:0.0:1789024043.040882:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301952 00000100:00100000:0.0:1789024043.040886:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301952 00000100:00100000:0.0:1789024043.040910:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:0.0:1789024043.040922:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402301824:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024043.041268:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402301824:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 347us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024043.041278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:0.0:1789024043.041306:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:0.0:1789024043.041315:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402302080:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024043.041347:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402302080:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 34us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024043.041353:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:0.0:1789024043.041366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:0.0:1789024043.041383:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402301696:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024043.041418:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402301696:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 45us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024043.042364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:0.0:1789024043.042407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00100000:0.0:1789024043.042421:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301952:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024043.046972:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2401:x1875927402301952:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 4546us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024043.047663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00080000:2.0:1789024043.049709:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024043.049736:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024043.053215:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402301568 00000100:00100000:3.0:1789024043.053245:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402301568 00000100:00100000:3.0:1789024043.053346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 314 00000100:00100000:3.0:1789024043.053361:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402301568:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024043.053860:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402301568:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 500us (15132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024043.053873:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 314 00000001:02000400:1.0:1789024043.187478:0:13040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789024043.854250:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024044.428529:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024044.428556:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422304128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024044.428628:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024044.428760:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304128 00000100:00100000:3.0:1789024044.428769:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304128 00000100:00100000:3.0:1789024044.428984:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789024044.429011:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422304128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024044.429047:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789024044.429112:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422304128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024044.429119:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789024044.429200:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422304128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024044.877564:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024045.902122:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024046.476354:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024046.476379:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422304256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024046.476456:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024046.476522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304256 00000100:00100000:3.0:1789024046.476530:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304256 00000100:00100000:3.0:1789024046.476587:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789024046.476596:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422304256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024046.476631:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024046.476674:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422304256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024046.476681:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789024046.476730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422304256:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1789024046.540390:0:13188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebb00cb30 20000000:00000080:3.0:1789024046.540419:0:13188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb0383f000 uarg=0000000000000000 20000000:01000000:3.0:1789024046.540477:0:13188:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789024046.540484:0:13188:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789024046.540489:0:13188:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789024046.541334:0:13189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789024046.541541:0:13188:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789024046.547113:0:13188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789024046.547388:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547409:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547418:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547425:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547431:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547459:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547467:0:13188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547475:0:13188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547530:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547548:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547567:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304384:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024046.547686:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547706:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547715:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304512:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024046.547747:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547755:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 23 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547775:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304640:0@lo:104: 00000100:00100000:3.0:1789024046.547818:0:13188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024046.547859:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547867:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 23 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547875:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304768:0@lo:104: 00000100:00100000:3.0:1789024046.547892:0:13188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024046.547915:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547923:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 23 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547931:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304896:0@lo:104: 00000100:00100000:3.0:1789024046.547947:0:13188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024046.547959:0:13188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.547967:0:13188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 23 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.547975:0:13188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422305024:0@lo:104: 00000100:00100000:3.0:1789024046.547992:0:13188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024046.548001:0:13188:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789024046.548570:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304640 00000100:00100000:1.0:1789024046.548580:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304640 00000100:00100000:1.0:1789024046.548618:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304768 00000100:00100000:1.0:1789024046.548620:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304768 00000100:00100000:1.0:1789024046.548630:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422304896 00000100:00100000:1.0:1789024046.548632:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422304896 00000100:00100000:1.0:1789024046.548639:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305024 00000100:00100000:1.0:1789024046.548641:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305024 00000100:00100000:1.0:1789024046.548654:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789024046.548662:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+6:13188:x1875927422304640:12345-0@lo:104: 00010000:00010000:1.0:1789024046.548676:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.548768:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789024046.548774:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+6:13188:x1875927422304640:12345-0@lo:104: Request processed in 113us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024046.548781:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789024046.548805:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789024046.548810:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:13188:x1875927422304768:12345-0@lo:104: 00010000:00010000:1.0:1789024046.548817:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.548851:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789024046.548856:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:13188:x1875927422304768:12345-0@lo:104: Request processed in 46us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024046.548860:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789024046.548873:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789024046.548877:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:13188:x1875927422304896:12345-0@lo:104: 00010000:00010000:1.0:1789024046.548884:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.548915:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789024046.548920:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:13188:x1875927422304896:12345-0@lo:104: Request processed in 43us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024046.548925:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789024046.548937:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789024046.548943:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:13188:x1875927422305024:12345-0@lo:104: 00010000:00010000:1.0:1789024046.548950:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.548993:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789024046.548998:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:13188:x1875927422305024:12345-0@lo:104: Request processed in 56us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024046.549003:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789024046.549021:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789024046.549027:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.549035:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024046.549039:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.549048:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024046.549055:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024046.549062:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789024046.549096:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.549102:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024046.549126:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024046.549133:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0252f400/0xa736ef4b98cb3715 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb371c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549349:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789024046.549355:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549362:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024046.549365:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549372:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024046.549379:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024046.549384:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789024046.549399:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549404:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024046.549411:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549417:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01489e00/0xa736ef4b98cb3707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb370e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549433:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024046.549443:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549449:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024046.549452:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549459:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024046.549465:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024046.549471:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789024046.549487:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549493:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024046.549511:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549518:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01489a00/0xa736ef4b98cb36f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3700 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549527:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024046.549530:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549536:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024046.549539:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549555:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024046.549562:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024046.549568:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789024046.549580:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549586:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024046.549591:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549597:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01488800/0xa736ef4b98cb36eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb36f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549607:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024046.549608:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024046.549610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024046.549637:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422305408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024046.549681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024046.549733:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024046.549739:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422305536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024046.549760:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024046.549795:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305408 00000100:00100000:0.0:1789024046.549801:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305408 00010000:00010000:0.0:1789024046.549828:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 24 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.549867:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305536 00000100:00100000:0.0:1789024046.549870:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305536 00010000:00010000:0.0:1789024046.549890:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 25 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.549908:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024046.549915:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422305408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.549928:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.549933:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 25 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549942:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 25 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.549959:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.549988:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+25:3643:x1875927422305408:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.549995:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024046.550010:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024046.550015:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422305536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.550022:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.550026:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.550032:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.550041:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.550068:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422305536:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.550074:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024046.550119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422305536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024046.550128:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422305408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789024046.550336:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024046.550338:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024046.550350:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024046.550358:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024046.550363:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024046.550374:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422305152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024046.550402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024046.550428:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024046.550433:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422305280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024046.550452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024046.550530:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305152 00000100:00100000:0.0:1789024046.550535:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305152 00010000:00010000:0.0:1789024046.550552:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.550580:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305280 00000100:00100000:0.0:1789024046.550583:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305280 00010000:00010000:0.0:1789024046.550594:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 25 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.550611:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789024046.550617:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+25:3641:x1875927422305152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.550624:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.550628:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 25 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.550637:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 25 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.550647:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.550677:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+25:3641:x1875927422305152:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.550682:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789024046.550952:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb371c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3715 expref: 25 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.550975:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304640:0@lo:104: 00000100:00100000:3.0:1789024046.550988:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304768:0@lo:104: 00010000:00010000:3.0:1789024046.550997:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01488600/0xa736ef4b98cb3700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb36f9 expref: 24 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.551005:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304896:0@lo:104: 00010000:00010000:3.0:1789024046.551013:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb36f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb36eb expref: 23 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.551021:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422305024:0@lo:104: 00000100:00100000:0.0:1789024046.551067:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789024046.551080:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+21:3641:x1875927422305280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.551089:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.551094:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 21 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.551102:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 21 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.551112:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb370e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3707 expref: 21 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.551121:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.551299:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2a60d918-c836-4e5c-bd08-febd347ea726+20:3641:x1875927422305280:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.551306:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789024046.551333:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422305280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024046.551354:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422305152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024046.565548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024046.565594:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024046.565669:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302208 00000100:00100000:0.0:1789024046.565679:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302208 00010000:00010000:0.0:1789024046.565744:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 13 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.565782:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302336 00000100:00100000:0.0:1789024046.565785:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302336 00010000:00010000:0.0:1789024046.565797:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 14 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024046.565820:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:0.0:1789024046.565829:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+14:2403:x1875927402302208:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.565860:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.565866:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 14 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.565880:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 14 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.565905:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.565963:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+14:2403:x1875927402302208:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 135us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.565971:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:0.0:1789024046.565992:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:0.0:1789024046.566000:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402302336:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024046.566007:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024046.566012:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 13 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566020:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 13 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566033:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566042:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566058:0:7924:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566075:0:7924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566081:0:7924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566088:0:7924:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566092:0:7924:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024046.566096:0:7924:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566104:0:7924:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566113:0:7924:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.566123:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024046.566143:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f197c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402302336:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 143us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024046.566182:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00010000:00010000:3.0:1789024046.566962:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb3738 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3dd expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.566981:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304384:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024046.566994:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3723 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af39e expref: 11 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024046.567003:0:13188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13188:1875927422304512:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024046.567035:0:13188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.567045:0:13188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.567051:0:13188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024046.567070:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb375b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024046.926926:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024047.501212:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422305664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024047.501293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024047.501725:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305664 00000100:00100000:0.0:1789024047.501739:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305664 00000100:00100000:0.0:1789024047.501826:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789024047.501840:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422305664:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789024047.501857:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789024047.501889:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024047.501962:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422305664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024047.501970:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789024047.502046:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03874380 x1875927422305664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024047.502074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422305664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024047.502645:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024047.502659:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422305792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024047.502700:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.502775:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305792 00000100:00100000:1.0:1789024047.502781:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305792 00000100:00100000:1.0:1789024047.502829:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789024047.502836:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422305792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024047.502847:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024047.502888:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422305792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024047.502893:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789024047.503036:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875500 x1875927422305792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024047.503055:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422305792:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789024047.503124:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789024047.633827:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024047.633839:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb021fb800 from 7 10000000:01000000:1.0:1789024047.633845:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024047.634071:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.634087:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.634111:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024047.634219:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422305920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.634307:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.634390:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.639846:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422305920 00000100:00100000:2.0:1789024047.639872:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422305920 00000100:00100000:2.0:1789024047.639975:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789024047.639988:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422305920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024047.640012:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024047.640043:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3762 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.640080:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.640130:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.640141:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0400, rc 0) 00000100:00100000:2.0:1789024047.640288:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422305920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 302us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.640296:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789024047.641964:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c027480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422305920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024047.642004:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.642019:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024047.642177:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.642249:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024047.642295:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198bed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.642659:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306048 00000100:00100000:2.0:1789024047.642671:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306048 00000100:00100000:2.0:1789024047.642741:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789024047.642754:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422306048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024047.642952:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422306048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.642960:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789024047.643057:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.643099:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.643551:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.643582:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024047.643819:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306176 00000100:00100000:3.0:1789024047.643827:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306176 00000100:00100000:3.0:1789024047.643876:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789024047.643887:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422306176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.644000:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422306176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024047.644008:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789024047.645805:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789024047.649749:0:13202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789024047.650233:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789024047.650290:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024047.650307:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.650323:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024047.650348:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789024047.650351:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc3bd3a000 from 7 10000000:01000000:3.0:1789024047.650354:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789024047.650428:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.650447:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.650463:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024047.650507:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.650618:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024047.650685:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.650887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306304 00000100:00100000:2.0:1789024047.650899:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306304 00000100:00100000:2.0:1789024047.650967:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789024047.650977:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422306304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024047.650995:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024047.651011:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3770 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.651040:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.651052:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.651072:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1c00, rc 0) 00000100:00100000:2.0:1789024047.651131:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.651138:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789024047.651772:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024047.651796:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.651809:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024047.651909:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.651966:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024047.652016:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.652085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306432 00000100:00100000:2.0:1789024047.652092:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306432 00000100:00100000:2.0:1789024047.652134:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789024047.652143:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024047.652321:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.652342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789024047.652725:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.652761:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.652811:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024047.652849:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.653036:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306560 00000100:00100000:2.0:1789024047.653041:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306560 00000100:00100000:2.0:1789024047.653082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789024047.653090:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024047.653220:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.653227:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789024047.653325:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038cca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789024047.654395:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789024047.656909:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789024047.656963:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024047.656981:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.656997:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024047.657010:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024047.657014:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc414b7800 from 7 10000000:01000000:1.0:1789024047.657017:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024047.657073:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.657083:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.657108:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024047.657207:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.657307:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.657403:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024047.657600:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306688 00000100:00100000:3.0:1789024047.657610:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306688 00000100:00100000:3.0:1789024047.657677:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789024047.657689:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422306688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024047.657708:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024047.657724:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb377e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.657756:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.657770:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024047.657780:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5000, rc 0) 00000100:00100000:3.0:1789024047.657874:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422306688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024047.657882:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789024047.657955:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024047.657971:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.657980:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024047.658053:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.658078:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.658132:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024047.658195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306816 00000100:00100000:3.0:1789024047.658207:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306816 00000100:00100000:3.0:1789024047.658242:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789024047.658249:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422306816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.660481:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422306816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2210us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024047.660497:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789024047.662028:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.662245:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.662364:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.662459:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024047.662637:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422306944 00000100:00100000:3.0:1789024047.662647:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422306944 00000100:00100000:3.0:1789024047.662953:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789024047.662965:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422306944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.663138:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422306944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024047.663180:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789024047.663285:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422306944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789024047.664027:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789024047.664089:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789024047.664111:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024047.664134:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.664165:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024047.664179:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024047.664182:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc199e6000 from 7 10000000:01000000:1.0:1789024047.664185:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024047.664226:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.664234:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.664245:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024047.664269:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.664324:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.665069:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.666032:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307072 00000100:00100000:2.0:1789024047.666047:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307072 00000100:00100000:2.0:1789024047.666372:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789024047.666388:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422307072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024047.666409:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024047.666429:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb378c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.666656:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.666669:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024047.666680:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1800, rc 0) 00000100:00100000:2.0:1789024047.666782:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422307072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 399us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024047.666862:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024047.666885:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.666896:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024047.666991:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.667042:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.667069:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024047.667240:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789024047.667276:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307200 00000100:00100000:2.0:1789024047.667281:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307200 00000100:00100000:2.0:1789024047.667297:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789024047.667304:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422307200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024047.667739:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422307200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024047.667749:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789024047.667826:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.667866:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024047.667914:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024047.667972:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1816fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024047.668008:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307328 00000100:00100000:3.0:1789024047.668014:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307328 00000100:00100000:3.0:1789024047.668084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789024047.668093:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422307328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024047.668393:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422307328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024047.668400:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789024047.668828:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422307328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789024047.670054:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789024047.672397:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789024047.672449:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024047.672473:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.672490:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024047.950668:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024048.013404:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024048.013436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422307456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024048.013538:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024048.014012:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307456 00000100:00100000:1.0:1789024048.014025:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307456 00000100:00100000:1.0:1789024048.014110:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789024048.014122:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422307456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024048.014193:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024048.014261:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422307456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024048.014269:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1789024048.014289:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789024048.014342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03874000 x1875927422307456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024048.014363:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422307456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024048.015171:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422307584:0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.015223:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024048.015502:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307584 00000100:00100000:0.0:1789024048.015510:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307584 00000100:00100000:0.0:1789024048.015559:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789024048.015569:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422307584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.030495:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422307968:0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.030613:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024048.030688:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024048.030697:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422308096:0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.030727:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024048.030773:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308096 00000100:00100000:3.0:1789024048.030793:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308096 00000100:00100000:3.0:1789024048.030855:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789024048.030865:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422308096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.030948:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422308096:12345-0@lo:400:kworker.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.030956:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789024048.031020:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422308096:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.032661:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422307840:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.034285:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.034381:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789024048.034396:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422307712:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.034443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.034478:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422308224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024048.034505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.034875:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307840 00000100:00100000:2.0:1789024048.034886:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307840 00000100:00100000:2.0:1789024048.034949:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789024048.034961:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422307840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.035036:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422307840:12345-0@lo:400:kworker.0 Request processed in 77us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.035043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789024048.035069:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308224 00000100:00100000:2.0:1789024048.035073:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308224 00000100:00100000:2.0:1789024048.035120:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789024048.035127:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422308224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024048.035171:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024048.035215:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422308224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.035221:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789024048.035263:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038ce680 x1875927422308224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024048.035288:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422308224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024048.035301:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422307840:0@lo:400:kworker.0 00000100:00080000:2.0:1789024048.035351:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024048.035407:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422308352:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.035446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.035481:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307968 00000100:00100000:2.0:1789024048.035485:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307968 00000100:00100000:2.0:1789024048.035529:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422307712 00000100:00100000:2.0:1789024048.035533:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422307712 00000100:00100000:2.0:1789024048.035546:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308352 00000100:00100000:2.0:1789024048.035548:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308352 00000100:00100000:2.0:1789024048.035569:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789024048.035576:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422307968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.035616:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422307968:12345-0@lo:400:kworker.0 Request processed in 41us (5004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.035623:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789024048.035635:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789024048.035640:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422307712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.035674:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422307712:12345-0@lo:400:kworker.0 Request processed in 34us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024048.036489:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422307584:12345-0@lo:400:kworker.0 Request processed in 20916us (21260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024048.036501:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789024048.036555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789024048.036569:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422308352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024048.036616:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422308352:12345-0@lo:400:kworker.0 Request processed in 52us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024048.036621:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789024048.037117:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422307584:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.037582:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789024048.037638:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422308352:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.037652:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422307712:0@lo:400:kworker.0 00000100:00080000:2.0:1789024048.037671:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024048.037811:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422307968:0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.037963:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422308480:0@lo:400:kworker.0 00000100:00100000:3.0:1789024048.038017:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024048.038113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308480 00000100:00100000:0.0:1789024048.038122:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308480 00000100:00100000:0.0:1789024048.038197:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789024048.038206:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422308480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789024048.038490:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024048.041065:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422308480:12345-0@lo:400:kworker.0 Request processed in 2847us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024048.041109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789024048.045995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422308608:0@lo:400:kworker.0 00000100:00100000:0.0:1789024048.046110:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789024048.046190:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875f80 x1875927422308480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024048.046215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422308480:0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.046864:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308608 00000100:00100000:1.0:1789024048.046878:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308608 00000100:00100000:1.0:1789024048.046945:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789024048.046958:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422308608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.047040:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422308608:12345-0@lo:400:kworker.0 Request processed in 85us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024048.047047:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789024048.047113:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03874e00 x1875927422308608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024048.047125:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422308608:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.049490:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789024048.049528:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422308736:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.049630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.049715:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422308864:0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.049768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024048.049803:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308864 00000100:00100000:2.0:1789024048.049812:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308864 00000100:00100000:2.0:1789024048.049886:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789024048.049897:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422308864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024048.049958:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422308864:12345-0@lo:400:kworker.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.049965:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789024048.050018:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422308864:0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.050302:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308736 00000100:00100000:1.0:1789024048.050308:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308736 00000100:00100000:1.0:1789024048.050356:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789024048.050364:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422308736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.050419:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422308736:12345-0@lo:400:kworker.0 Request processed in 56us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.050424:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422308992:0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.050426:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789024048.050458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789024048.050459:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024048.050474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422308992 00000100:00100000:1.0:1789024048.050477:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422308992 00000100:00100000:1.0:1789024048.050518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789024048.050526:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422308992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024048.050561:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422308992:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024048.050576:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1789024048.050592:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789024048.050644:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875880 x1875927422308992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024048.050657:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422308992:0@lo:400:kworker.0 00010000:00080000:2.0:1789024048.050956:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875c00 x1875927422308736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024048.050967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422308736:0@lo:400:kworker.0 00000100:00100000:0.0:1789024048.148914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024048.148993:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024048.148998:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302592 00000100:00100000:3.0:1789024048.149012:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302592 00000100:00100000:3.0:1789024048.149102:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:3.0:1789024048.149114:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402302592:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024048.149232:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402302592:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.149248:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:3.0:1789024048.149282:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302464 00000100:00100000:3.0:1789024048.149287:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302464 00000100:00100000:3.0:1789024048.149336:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 328 00000100:00100000:3.0:1789024048.149343:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:2402:x1875927402302464:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024048.149372:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:2402:x1875927402302464:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.149379:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 328 00000100:00080000:0.0:1789024048.149409:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024048.151315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024048.151485:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302848 00000100:00100000:2.0:1789024048.151497:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302848 00000100:00100000:2.0:1789024048.151586:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 200 00000100:00100000:2.0:1789024048.151599:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402302848:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024048.151692:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402302848:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.151701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 200 00000100:00080000:0.0:1789024048.151804:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024048.153793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024048.153858:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024048.153961:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302720 00000100:00100000:2.0:1789024048.153974:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302720 00000100:00100000:2.0:1789024048.154059:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402302976 00000100:00100000:2.0:1789024048.154064:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402302976 00000100:00100000:2.0:1789024048.154095:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:2.0:1789024048.154106:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402302720:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024048.154248:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402302720:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 144us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.154258:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:2.0:1789024048.154279:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00100000:2.0:1789024048.154297:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402302976:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024048.154335:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402302976:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 40us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.154341:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00080000:3.0:1789024048.154424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024048.278632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024048.278804:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303104 00000100:00100000:2.0:1789024048.278822:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303104 00000100:00100000:2.0:1789024048.278906:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 329 00000100:00100000:2.0:1789024048.278921:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+11:6174:x1875927402303104:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024048.278952:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024048.278981:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af40e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024048.279022:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024048.279048:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024048.279059:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1200, rc 0) 00000100:00100000:2.0:1789024048.279162:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303104:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 229us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024048.279170:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 329 00000100:00100000:0.0:1789024048.301537:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024048.302371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303232 00000100:00100000:3.0:1789024048.302389:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303232 00000100:00100000:3.0:1789024048.302478:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 330 00000100:00100000:3.0:1789024048.302491:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303232:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024048.302855:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303232:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 366us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.302865:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 330 00000100:00100000:0.0:1789024048.328320:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024048.328478:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303360 00000100:00100000:1.0:1789024048.328495:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303360 00000100:00100000:1.0:1789024048.328587:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 331 00000100:00100000:1.0:1789024048.328601:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303360:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024048.329025:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303360:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 425us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024048.329035:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 331 00000100:00100000:1.0:1789024048.348051:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024048.348419:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303488 00000100:00100000:3.0:1789024048.348433:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303488 00000100:00100000:3.0:1789024048.348503:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 332 00000100:00100000:3.0:1789024048.348516:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402303488:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024048.348542:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024048.348568:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af415 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024048.348623:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024048.348638:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024048.348649:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789024048.348878:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402303488:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 363us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.348886:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 332 00000100:00100000:0.0:1789024048.357488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024048.358382:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303616 00000100:00100000:1.0:1789024048.358412:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303616 00000100:00100000:1.0:1789024048.358528:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 333 00000100:00100000:1.0:1789024048.358542:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402303616:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024048.359004:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402303616:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 463us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024048.359013:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 333 00000100:00100000:2.0:1789024048.378141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024048.381236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303744 00000100:00100000:3.0:1789024048.381262:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303744 00000100:00100000:3.0:1789024048.381360:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 334 00000100:00100000:3.0:1789024048.381373:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402303744:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024048.381594:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402303744:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 222us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024048.381604:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 334 00010000:00010000:1.0:1789024048.975563:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024049.551141:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024049.552396:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422309120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024049.552491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024049.553636:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309120 00000100:00100000:0.0:1789024049.553651:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309120 00000100:00100000:0.0:1789024049.553728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789024049.553739:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422309120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024049.553791:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024049.553894:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422309120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024049.553901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789024049.555945:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422309120:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024050.005376:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024051.029765:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789024051.560433:0:13387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789024051.596628:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024051.599427:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422309248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024051.599519:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024051.602121:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309248 00000100:00100000:2.0:1789024051.602136:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309248 00000100:00100000:2.0:1789024051.602223:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789024051.602234:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422309248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024051.602273:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024051.602483:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422309248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 251us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024051.602492:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789024051.602547:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422309248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024052.046212:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024052.620776:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422309376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024052.620866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024052.621271:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309376 00000100:00100000:1.0:1789024052.621280:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309376 00000100:00100000:1.0:1789024052.621361:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789024052.621371:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422309376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024052.621400:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024052.621452:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422309376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024052.621467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1789024052.621529:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875c00 x1875927422309376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024052.621549:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422309376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789024052.621626:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024052.621685:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024052.621697:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422309504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024052.621731:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024052.624087:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309504 00000100:00100000:1.0:1789024052.624105:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309504 00000100:00100000:1.0:1789024052.624252:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789024052.624264:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422309504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024052.624305:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024052.624411:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422309504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024052.624419:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789024052.624589:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875880 x1875927422309504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024052.624613:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422309504:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789024052.624719:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789024053.068510:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024053.132571:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422309760:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132646:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132706:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422310272:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132731:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132752:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422310784:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132806:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789024053.132812:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422309888:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132856:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422310400:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132890:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422310912:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.132908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.132951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309760 00000100:00100000:0.0:1789024053.132959:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309760 00000100:00100000:0.0:1789024053.133026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310272 00000100:00100000:0.0:1789024053.133030:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310272 00000100:00100000:0.0:1789024053.133056:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310784 00000100:00100000:0.0:1789024053.133059:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310784 00000100:00100000:0.0:1789024053.133070:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310400 00000100:00100000:0.0:1789024053.133073:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310400 00000100:00100000:0.0:1789024053.133083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310912 00000100:00100000:0.0:1789024053.133085:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310912 00000100:00100000:0.0:1789024053.133099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789024053.133106:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422309760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133192:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422309760:12345-0@lo:400:kworker.0 Request processed in 86us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133216:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789024053.133239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789024053.133245:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422310272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133276:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422310272:12345-0@lo:400:kworker.0 Request processed in 31us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789024053.133312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789024053.133318:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422310784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133344:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422310784:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789024053.133360:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789024053.133366:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422310400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133392:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422310400:12345-0@lo:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789024053.133407:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789024053.133412:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422310912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133436:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422310912:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133441:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789024053.133466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309888 00000100:00100000:0.0:1789024053.133469:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309888 00000100:00100000:0.0:1789024053.133495:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789024053.133501:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133541:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422309888:12345-0@lo:400:kworker.0 Request processed in 40us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.133547:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789024053.133568:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024053.133573:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024053.133629:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422309888:0@lo:400:kworker.0 00010000:00080000:0.0:1789024053.133643:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c17b80 x1875927422310400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024053.133655:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422310400:0@lo:400:kworker.0 00010000:00080000:0.0:1789024053.133664:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c14380 x1875927422310912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024053.133672:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422310912:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133681:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422309760:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422310272:0@lo:400:kworker.0 00000100:00100000:0.0:1789024053.133699:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422310784:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134593:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422310016:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134691:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422310528:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134739:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422311040:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134784:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789024053.134790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422309632:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134818:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134837:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422310144:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134859:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134888:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422310656:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.134940:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422311168:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.134958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024053.135085:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310528 00000100:00100000:2.0:1789024053.135093:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310528 00000100:00100000:2.0:1789024053.135129:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311040 00000100:00100000:2.0:1789024053.135131:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311040 00000100:00100000:2.0:1789024053.135175:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310656 00000100:00100000:2.0:1789024053.135178:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310656 00000100:00100000:2.0:1789024053.135186:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311168 00000100:00100000:2.0:1789024053.135188:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311168 00000100:00100000:2.0:1789024053.135201:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789024053.135208:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422310528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.135252:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422310528:12345-0@lo:400:kworker.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.135257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789024053.135271:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789024053.135287:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422311040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.135314:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422311040:12345-0@lo:400:kworker.0 Request processed in 38us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.135319:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789024053.135328:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789024053.135333:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422310656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.135357:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422310656:12345-0@lo:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.135363:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789024053.135382:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789024053.135388:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422311168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.135417:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422311168:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.135423:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789024053.135443:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024053.135635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024053.135667:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024053.135761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422309632 00000100:00100000:3.0:1789024053.135766:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422309632 00000100:00100000:1.0:1789024053.135875:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310144 00000100:00100000:1.0:1789024053.135880:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310144 00000100:00100000:1.0:1789024053.135910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789024053.135917:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422310144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024053.135955:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422310144:12345-0@lo:400:kworker.0 Request processed in 38us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024053.135960:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789024053.136085:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024053.136094:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024053.136120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024053.136212:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311296 00000100:00100000:0.0:1789024053.136217:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311296 00000100:00100000:0.0:1789024053.136241:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311424 00000100:00100000:0.0:1789024053.136252:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311424 00000100:00100000:0.0:1789024053.136270:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789024053.136286:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422311296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789024053.136306:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024053.136342:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422311296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.136347:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789024053.136363:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789024053.136369:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422311424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789024053.136379:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024053.136402:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422311424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024053.136406:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789024053.136437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f955f80 x1875927422311424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024053.136455:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422311424:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789024053.136477:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fd500 x1875927422311296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024053.136547:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422310144:0@lo:400:kworker.0 00010000:00080000:2.0:1789024053.136561:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c16680 x1875927422310656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024053.136570:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422310656:0@lo:400:kworker.0 00010000:00080000:2.0:1789024053.136579:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c15500 x1875927422311168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024053.136586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422311168:0@lo:400:kworker.0 00010000:00080000:2.0:1789024053.136597:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c16d80 x1875927422310528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024053.136605:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422310528:0@lo:400:kworker.0 00010000:00080000:2.0:1789024053.136615:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc30c14e00 x1875927422311040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024053.136623:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422311040:0@lo:400:kworker.0 00000100:00100000:3.0:1789024053.141765:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789024053.141790:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422309632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024053.141889:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422309632:12345-0@lo:400:kworker.0 Request processed in 112us (7070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024053.141896:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789024053.142665:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422310016 00000100:00100000:3.0:1789024053.142677:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422310016 00000100:00100000:3.0:1789024053.142726:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789024053.142735:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422310016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024053.142789:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422310016:12345-0@lo:400:kworker.0 Request processed in 56us (8144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024053.142796:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789024053.144780:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422311296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024053.145184:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422309632:0@lo:400:kworker.0 00000100:00100000:2.0:1789024053.145205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422310016:0@lo:400:kworker.0 00000100:00100000:1.0:1789024053.271646:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024053.271684:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024053.271725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024053.271749:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024053.271767:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024053.271792:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402303872 00000100:00100000:1.0:1789024053.271812:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402303872 00000100:00100000:1.0:1789024053.271868:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 336 00000100:00100000:1.0:1789024053.271879:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402303872:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024053.271948:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402303872:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024053.271956:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 336 00000100:00100000:2.0:1789024053.272040:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304000 00000100:00100000:2.0:1789024053.272051:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304000 00000100:00100000:2.0:1789024053.272097:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304256 00000100:00100000:2.0:1789024053.272101:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304256 00000100:00100000:2.0:1789024053.272114:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304128 00000100:00100000:2.0:1789024053.272116:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304128 00000100:00100000:2.0:1789024053.272130:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304384 00000100:00100000:2.0:1789024053.272133:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304384 00000100:00100000:2.0:1789024053.272196:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 209 00000100:00100000:2.0:1789024053.272205:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402304000:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024053.272242:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402304000:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 38us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.272247:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 209 00000100:00100000:2.0:1789024053.272261:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 210 00000100:00100000:2.0:1789024053.272267:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402304256:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024053.272306:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402304256:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.272311:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 210 00000100:00100000:2.0:1789024053.272325:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:2.0:1789024053.272331:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402304128:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024053.272355:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402304128:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 24us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.272361:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:2.0:1789024053.272372:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 212 00000100:00100000:2.0:1789024053.272379:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402304384:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024053.272400:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402304384:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 22us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024053.272413:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 212 00000100:00080000:1.0:1789024053.273567:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024053.273575:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789024054.092606:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024054.669048:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422311552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024054.669211:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024054.669444:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311552 00000100:00100000:0.0:1789024054.669458:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311552 00000100:00100000:0.0:1789024054.669529:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789024054.669541:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422311552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024054.669590:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024054.687817:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422311552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 18144us (18471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024054.687838:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789024054.690590:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422311552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024055.123760:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024056.141498:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024056.728644:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024056.728677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422311680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024056.728757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024056.728893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311680 00000100:00100000:3.0:1789024056.728903:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311680 00000100:00100000:3.0:1789024056.728964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789024056.728975:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422311680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024056.729010:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024056.729065:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422311680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024056.729073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789024056.729119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422311680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024057.164678:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024057.740881:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422311808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024057.740957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024057.741093:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311808 00000100:00100000:2.0:1789024057.741103:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311808 00000100:00100000:2.0:1789024057.741204:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789024057.741215:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422311808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024057.741257:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024057.741305:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422311808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024057.741313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789024057.741325:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422311936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024057.741356:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789024057.741448:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024057.741566:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422311936 00000100:00100000:0.0:1789024057.741571:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422311936 00000100:00100000:0.0:1789024057.741625:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789024057.741633:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422311936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789024057.741644:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789024057.741672:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024057.741817:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422311936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024057.741824:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789024057.741974:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3c026d80 x1875927422311936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024057.741994:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422311936:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789024057.742040:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03875880 x1875927422311808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024057.742052:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422311808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789024058.188431:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024058.252444:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024058.252470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422312064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024058.252552:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024058.253031:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024058.253045:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422312192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024058.253082:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024058.253174:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312064 00000100:00100000:2.0:1789024058.253181:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312192 00000100:00100000:3.0:1789024058.253185:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312064 00000100:00100000:2.0:1789024058.253185:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312192 00000100:00100000:3.0:1789024058.253383:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1789024058.253425:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024058.253471:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789024058.253480:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422312192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024058.253511:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024058.253563:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422312192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024058.253570:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1789024058.253643:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc2d0fdc00 x1875927422312192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024058.253682:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc2d0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422312192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024058.254393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422312576:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254422:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422312320:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254436:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024058.254453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024058.254468:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422313088:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254476:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422312832:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024058.254495:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024058.254507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422313600:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422313344:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024058.254526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024058.254544:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789024058.254544:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789024058.254550:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422312448:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254550:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422312704:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254569:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024058.254576:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312576 00000100:00100000:1.0:1789024058.254582:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312576 00000100:00100000:2.0:1789024058.254603:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422312960:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254613:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312832 00000100:00100000:1.0:1789024058.254616:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312832 00000100:00100000:1.0:1789024058.254629:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789024058.254635:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024058.254671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422313472:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254684:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422312576:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024058.254688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024058.254691:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789024058.254715:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789024058.254721:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312320 00000100:00100000:1.0:1789024058.254721:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422312832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.254724:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312320 00000100:00100000:2.0:1789024058.254753:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789024058.254753:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422312832:12345-0@lo:400:kworker.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024058.254758:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422312320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.254759:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789024058.254777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313088 00000100:00100000:1.0:1789024058.254780:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313088 00000100:00100000:2.0:1789024058.254786:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422312320:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024058.254791:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789024058.254801:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313600 00000100:00100000:1.0:1789024058.254803:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313600 00000100:00100000:1.0:1789024058.254814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312448 00000100:00100000:2.0:1789024058.254817:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312960 00000100:00100000:1.0:1789024058.254817:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312448 00000100:00100000:2.0:1789024058.254820:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312960 00000100:00100000:1.0:1789024058.254825:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313472 00000100:00100000:1.0:1789024058.254828:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313472 00000100:00100000:2.0:1789024058.254835:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789024058.254848:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422313088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.256695:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422313088:12345-0@lo:400:kworker.0 Request processed in 1832us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.257720:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422312064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024058.257750:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024058.257819:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422312064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4428us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.257828:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789024058.257910:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313344 00000100:00100000:3.0:1789024058.257919:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313344 00000100:00100000:3.0:1789024058.257968:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789024058.257976:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422313344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024058.258012:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422313344:12345-0@lo:400:kworker.0 Request processed in 37us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.258017:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789024058.258131:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789024058.258142:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422313600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.258200:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422313600:12345-0@lo:400:kworker.0 Request processed in 61us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024058.258206:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789024058.258313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789024058.258322:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422312448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.258358:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422312448:12345-0@lo:400:kworker.0 Request processed in 38us (3788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024058.258363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789024058.258379:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789024058.258403:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422312960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.258435:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422312960:12345-0@lo:400:kworker.0 Request processed in 34us (3784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024058.258441:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789024058.258455:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789024058.258461:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422313472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789024058.258863:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024058.258869:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789024058.258951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f955880 x1875927422312064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024058.258978:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422312064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024058.259018:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024058.259052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422313216:0@lo:400:kworker.0 00000100:00100000:0.0:1789024058.259090:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024058.259125:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422312576:0@lo:400:kworker.0 00010000:00080000:0.0:1789024058.259171:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc355b7800 x1875927422313088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024058.259180:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422313088:0@lo:400:kworker.0 00010000:00080000:0.0:1789024058.259193:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc355b7b80 x1875927422313600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024058.259200:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422313600:0@lo:400:kworker.0 00000100:00100000:0.0:1789024058.259226:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313216 00000100:00100000:1.0:1789024058.260803:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422313472:12345-0@lo:400:kworker.0 Request processed in 2329us (6100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024058.260819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789024058.260885:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422312704 00000100:00100000:1.0:1789024058.260895:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422312704 00000100:00100000:1.0:1789024058.260932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789024058.260941:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422312704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.261024:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422312704:12345-0@lo:400:kworker.0 Request processed in 85us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024058.261030:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789024058.261098:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422312448:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.261116:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422312960:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.261128:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422313472:0@lo:400:kworker.0 00000100:00100000:1.0:1789024058.261139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422312320:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.261155:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789024058.261165:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422312832:0@lo:400:kworker.0 00010000:00080000:1.0:1789024058.261182:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc355b5180 x1875927422313344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024058.261216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422313344:0@lo:400:kworker.0 00000100:00100000:2.0:1789024058.261225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422312704:0@lo:400:kworker.0 00000100:00100000:0.0:1789024058.263688:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313216 00000100:00100000:0.0:1789024058.263787:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789024058.263799:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422313216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024058.263917:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422313216:12345-0@lo:400:kworker.0 Request processed in 121us (4825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024058.263925:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789024058.264181:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc355b4380 x1875927422313216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024058.264198:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422313216:0@lo:400:kworker.0 00000100:00100000:3.0:1789024058.389369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024058.389429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024058.389476:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024058.389486:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304512 00000100:00100000:2.0:1789024058.389500:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304512 00000100:00100000:3.0:1789024058.389513:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024058.389537:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304640 00000100:00100000:3.0:1789024058.389542:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304640 00000100:00100000:3.0:1789024058.389584:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304768 00000100:00100000:3.0:1789024058.389588:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304768 00000100:00100000:2.0:1789024058.389600:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 338 00000100:00100000:3.0:1789024058.389609:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402304896 00000100:00100000:3.0:1789024058.389613:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402304896 00000100:00100000:3.0:1789024058.389633:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 219 00000100:00100000:3.0:1789024058.389642:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402304640:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024058.389721:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402304640:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.389728:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 219 00000100:00100000:3.0:1789024058.389745:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 220 00000100:00100000:3.0:1789024058.389751:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402304768:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024058.389771:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402304512:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024058.389780:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402304768:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.389787:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 220 00000100:00100000:2.0:1789024058.389801:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402304512:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.389807:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 221 00000100:00100000:2.0:1789024058.389812:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 338 00000100:00100000:3.0:1789024058.389820:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402304896:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024058.389862:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402304896:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.389869:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 221 00000100:00080000:0.0:1789024058.390075:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024058.390080:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024058.392650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024058.392771:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305024 00000100:00100000:3.0:1789024058.392781:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305024 00000100:00100000:3.0:1789024058.392861:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 222 00000100:00100000:3.0:1789024058.392878:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402305024:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024058.392952:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402305024:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024058.392959:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 222 00000100:00080000:0.0:1789024058.393300:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789024059.218884:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789024059.325018:0:13536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:07:38 (1789024058) === 00000100:00100000:1.0:1789024059.595422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.595518:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.595551:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305152 00000100:00100000:1.0:1789024059.595562:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305152 00000100:00100000:1.0:1789024059.595619:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:1.0:1789024059.595630:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402305152:12345-192.168.202.18@tcp:41:mkdir.0 00000004:00000024:1.0:1789024059.595688:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024059.595939:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402305152:12345-192.168.202.18@tcp:41:mkdir.0 Request processed in 310us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024059.595947:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:3.0:1789024059.605012:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305280 00000100:00100000:3.0:1789024059.605034:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305280 00000100:00100000:3.0:1789024059.605093:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:3.0:1789024059.605105:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:10499:x1875927402305280:12345-192.168.202.18@tcp:700:mkdir.0 00000100:00100000:3.0:1789024059.605230:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:10499:x1875927402305280:12345-192.168.202.18@tcp:700:mkdir.0 Request processed in 127us (9820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.605238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:3.0:1789024059.618260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.618300:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305536 00000100:00100000:3.0:1789024059.618311:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305536 00000100:00100000:3.0:1789024059.618363:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:3.0:1789024059.618373:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:10499:x1875927402305536:12345-192.168.202.18@tcp:36:mkdir.0 00010000:00010000:3.0:1789024059.618429:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024059.618513:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb364a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af389 expref: 6 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618537:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1c890400) 00010000:00010000:3.0:1789024059.618549:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024059.618637:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618652:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618670:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618700:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618708:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.618715:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619250:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619260:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619268:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024059.619282:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034f14257 reply state 00000000321dce36 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619293:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619298:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:3.0:1789024059.619301:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024059.619304:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789024059.619309:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789024059.619317:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619330:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619336:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619342:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.619346:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619353:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619361:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024059.619364:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.619367:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619373:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024059.619387:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034f14257 reply state 00000000321dce36 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619394:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.619400:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb0231b400) 00010000:00010000:3.0:1789024059.619402:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024059.619404:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789024059.619495:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10499:x1875927402305536:12345-192.168.202.18@tcp:36:mkdir.0 Request processed in 1120us (1243us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789024059.619509:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:2.0:1789024059.631890:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024059.634872:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305664 00000100:00100000:0.0:1789024059.634890:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305664 00000100:00100000:0.0:1789024059.634952:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:0.0:1789024059.634962:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10500:x1875927402305664:12345-192.168.202.18@tcp:101:chmod.0 00010000:00010000:0.0:1789024059.634985:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024059.635013:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb37bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af41c expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635086:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635107:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635121:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024059.635188:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789024059.635192:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024059.635240:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635268:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb37bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af41c expref: 9 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635285:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af41c expref: 8 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.635292:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7a00) 00010000:00010000:0.0:1789024059.635295:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024059.635299:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e600, rc 0) 00000100:00100000:0.0:1789024059.635368:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:10500:x1875927402305664:12345-192.168.202.18@tcp:101:chmod.0 Request processed in 407us (5375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024059.635375:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:2.0:1789024059.645008:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024059.645096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402305920 00000100:00100000:0.0:1789024059.645109:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402305920 00000100:00100000:0.0:1789024059.645190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:0.0:1789024059.645201:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:10500:x1875927402305920:12345-192.168.202.18@tcp:36:chmod.0 00010000:00010000:0.0:1789024059.645272:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024059.645313:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb37c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af41c expref: 8 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.645332:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7a00) 00010000:00010000:0.0:1789024059.645343:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024059.645366:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.645379:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.645389:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024059.645723:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a52c4fd reply state 00000000d231cec3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.645812:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.645819:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:0.0:1789024059.645821:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789024059.645824:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789024059.645834:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789024059.645948:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+9:10500:x1875927402305920:12345-192.168.202.18@tcp:36:chmod.0 Request processed in 748us (953us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789024059.645956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:0.0:1789024059.677128:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.677257:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306048 00000100:00100000:1.0:1789024059.677269:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306048 00000100:00100000:1.0:1789024059.677332:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:1.0:1789024059.677352:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+9:10501:x1875927402306048:12345-192.168.202.18@tcp:101:chown.0 00010000:00010000:1.0:1789024059.677379:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024059.677402:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af423 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677475:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677490:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677502:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024059.677577:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789024059.677581:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024059.677623:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677653:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af423 expref: 11 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677673:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af423 expref: 10 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.677681:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:1.0:1789024059.677684:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789024059.677688:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54c00, rc 0) 00000100:00100000:1.0:1789024059.677752:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+10:10501:x1875927402306048:12345-192.168.202.18@tcp:101:chown.0 Request processed in 402us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024059.677759:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:2.0:1789024059.694275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.694519:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306176 00000100:00100000:3.0:1789024059.694531:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306176 00000100:00100000:3.0:1789024059.694602:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:3.0:1789024059.694613:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:10501:x1875927402306176:12345-192.168.202.18@tcp:101:chown.0 00010000:00010000:3.0:1789024059.694635:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.694659:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af42a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694732:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694748:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694761:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694772:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694779:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694785:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694859:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694887:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694894:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.694937:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024059.694941:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024059.694964:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694976:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694983:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694989:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.694996:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.695000:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695008:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695019:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:3.0:1789024059.695022:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.695027:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695043:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb37e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695057:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695062:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695066:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695071:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.695074:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695080:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695088:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb0231b400) 00010000:00010000:3.0:1789024059.695091:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.695095:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695100:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb37ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695127:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb37e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af42a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695140:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af42a expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.695474:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:3.0:1789024059.695476:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024059.695479:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00100000:3.0:1789024059.695549:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10501:x1875927402306176:12345-192.168.202.18@tcp:101:chown.0 Request processed in 938us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.695558:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:3.0:1789024059.698651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024059.698838:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306304 00000100:00100000:0.0:1789024059.698849:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306304 00000100:00100000:0.0:1789024059.698919:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024059.698938:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10501:x1875927402306304:12345-192.168.202.18@tcp:900:chown.0 00000100:00100000:0.0:1789024059.699031:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10501:x1875927402306304:12345-192.168.202.18@tcp:900:chown.0 Request processed in 96us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024059.699040:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024059.702792:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.702898:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306560 00000100:00100000:1.0:1789024059.702909:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306560 00000100:00100000:1.0:1789024059.702976:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:1.0:1789024059.702986:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10501:x1875927402306560:12345-192.168.202.18@tcp:36:chown.0 00010000:00010000:1.0:1789024059.703043:0:7824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024059.703073:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb37f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af42a expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.703092:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:1.0:1789024059.703112:0:7824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024059.703139:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.703202:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.703212:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024059.716311:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1789024059.716652:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716665:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716673:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716679:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.716683:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716690:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716706:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb0231b400) 00010000:00010000:3.0:1789024059.716709:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.716714:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716720:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb37af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716777:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716783:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716788:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716793:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.716796:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716802:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716809:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:3.0:1789024059.716812:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.716814:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716819:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb37b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716832:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716838:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716843:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716854:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.716857:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716863:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716870:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:3.0:1789024059.716872:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789024059.716875:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.716880:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb37cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024059.721087:0:7824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e470adf3 reply state 000000004185fa4c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.721117:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.721126:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:0.0:1789024059.721129:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789024059.721134:0:7824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789024059.721172:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1789024059.721645:0:7824:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789024059.732969:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10501:x1875927402306560:12345-192.168.202.18@tcp:36:chown.0 Request processed in 29969us (30173us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789024059.732984:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00010000:00010000:2.0:1789024059.743693:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743714:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743761:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743768:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024059.743773:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743782:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743806:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231bc00) 00010000:00010000:2.0:1789024059.743809:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789024059.743814:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.743821:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb37fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024059.748643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.749269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306688 00000100:00100000:3.0:1789024059.749280:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306688 00000100:00100000:3.0:1789024059.749434:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:3.0:1789024059.749445:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:10502:x1875927402306688:12345-192.168.202.18@tcp:101:touch.500 00010000:00010000:3.0:1789024059.749472:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.749495:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af431 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789024059.750438:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 886us 00010000:00010000:3.0:1789024059.777928:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.777961:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.777974:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778002:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778010:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778016:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778131:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778139:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778170:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.778206:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024059.778210:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024059.778260:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778274:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778281:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778288:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778305:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.778309:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778317:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778328:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:3.0:1789024059.778332:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.778349:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778356:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489a00/0xa736ef4b98cb380a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778369:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778374:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778380:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778384:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.778387:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778392:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778410:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb0231b400) 00010000:00010000:3.0:1789024059.778413:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.778416:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778422:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01489e00/0xa736ef4b98cb3811 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778465:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af431 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778480:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af431 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.778488:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024059.778490:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789024059.778492:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488600, rc 0) 00000100:00100000:3.0:1789024059.778573:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10502:x1875927402306688:12345-192.168.202.18@tcp:101:touch.500 Request processed in 29129us (29939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.778581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:3.0:1789024059.789322:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024059.789347:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422313728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024059.797308:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024059.799491:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313728 00000100:00100000:1.0:1789024059.799511:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313728 00000100:00100000:1.0:1789024059.799585:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789024059.799595:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422313728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024059.799628:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024059.799718:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422313728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024059.799725:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789024059.799863:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422313728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024059.800242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024059.800995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402306944 00000100:00100000:2.0:1789024059.801004:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402306944 00000100:00100000:2.0:1789024059.801068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:2.0:1789024059.801077:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10502:x1875927402306944:12345-192.168.202.18@tcp:101:touch.500 00010000:00010000:2.0:1789024059.801093:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024059.801115:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb381f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af438 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801288:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801304:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801317:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801332:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801340:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.801347:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789024059.805248:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789024059.805469:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb3834 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805485:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb3834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805497:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb3834 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805536:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805580:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805587:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805600:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024059.805605:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805612:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805624:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:2.0:1789024059.805627:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024059.805632:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805638:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3826 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024059.805660:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce6512f7 reply state 000000008f6b15dc transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805672:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.805685:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff90cc35213100) 00010000:00010000:2.0:1789024059.805688:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024059.805692:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789024059.807238:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb381f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af438 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.807285:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb3834 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af438 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.807294:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213d00) 00010000:00010000:2.0:1789024059.807297:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024059.807300:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0a00, rc 0) 00000100:00100000:2.0:1789024059.807386:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+10:10502:x1875927402306944:12345-192.168.202.18@tcp:101:touch.500 Request processed in 6308us (10055us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789024059.807395:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:3.0:1789024059.822982:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024059.824410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307200 00000100:00100000:2.0:1789024059.824424:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307200 00000100:00100000:2.0:1789024059.824501:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:2.0:1789024059.824514:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:10502:x1875927402307200:12345-192.168.202.18@tcp:36:touch.500 00010000:00010000:2.0:1789024059.824643:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024059.824681:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb3834 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af438 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.824719:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213d00) 00010000:00010000:2.0:1789024059.824859:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789024059.824914:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.824928:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.824939:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024059.826939:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006021fa74 reply state 00000000a941d68f transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.826979:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.826989:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:2.0:1789024059.826992:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024059.826997:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789024059.827923:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10502:x1875927402307200:12345-192.168.202.18@tcp:36:touch.500 Request processed in 3403us (4942us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789024059.827934:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:3.0:1789024059.831435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.832241:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307328 00000100:00100000:1.0:1789024059.832254:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307328 00000100:00100000:1.0:1789024059.832580:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 32 00000100:00100000:1.0:1789024059.832603:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+11:10502:x1875927402307328:12345-192.168.202.18@tcp:101:touch.500 00010000:00010000:1.0:1789024059.832633:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024059.832655:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3849 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af43f expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.832748:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af43f expref: 12 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.832792:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3849 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af43f expref: 12 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.832818:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:1.0:1789024059.832822:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024059.832827:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54600, rc 0) 00000100:00100000:1.0:1789024059.832906:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+12:10502:x1875927402307328:12345-192.168.202.18@tcp:101:touch.500 Request processed in 315us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024059.836383:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 32 00000100:00100000:0.0:1789024059.838952:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.840596:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307456 00000100:00100000:1.0:1789024059.840610:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307456 00000100:00100000:1.0:1789024059.840670:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:1.0:1789024059.840679:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1875927402307456:12345-192.168.202.18@tcp:8:touch.500 00010000:00080000:1.0:1789024059.840715:0:10202:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:1.0:1789024059.840763:0:10202:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb3850 00002000:00100000:1.0:1789024059.840777:0:10202:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 382f7d83-ada1-4b7e-b952-8068d9fee082/ffff90cb038e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789024059.840797:0:10202:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789024059.840881:0:10202:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789024059.840913:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cb038ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024059.841003:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402307456:12345-192.168.202.18@tcp:8:touch.500 Request processed in 323us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024059.841011:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:3.0:1789024059.847983:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024059.848117:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307584 00000100:00100000:2.0:1789024059.848128:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307584 00000100:00100000:2.0:1789024059.848256:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024059.848268:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:0:x1875927402307584:12345-192.168.202.18@tcp:2:touch.500 00000100:00080000:0.0:1789024059.848480:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789024059.866941:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789024059.866961:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:2.0:1789024059.867290:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:0:x1875927402307584:12345-192.168.202.18@tcp:2:touch.500 Request processed in 19018us (19318us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789024059.867302:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024059.870283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.870491:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307840 00000100:00100000:3.0:1789024059.870532:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307840 00000100:00100000:3.0:1789024059.870610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:3.0:1789024059.870621:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+12:10502:x1875927402307840:12345-192.168.202.18@tcp:35:touch.500 00000100:00100000:3.0:1789024059.871489:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+13:10502:x1875927402307840:12345-192.168.202.18@tcp:35:touch.500 Request processed in 867us (1214us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789024059.871502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:0.0:1789024059.897268:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.897478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402307968 00000100:00100000:3.0:1789024059.897491:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402307968 00000100:00100000:3.0:1789024059.897564:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:3.0:1789024059.897585:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+13:10503:x1875927402307968:12345-192.168.202.18@tcp:101:rm.0 00010000:00010000:3.0:1789024059.897614:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.897639:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af446 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897737:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897756:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897771:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.897823:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024059.897827:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024059.897870:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897897:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af446 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897927:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af446 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.897933:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024059.897936:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024059.897939:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4a00, rc 0) 00000100:00100000:3.0:1789024059.897999:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+14:10503:x1875927402307968:12345-192.168.202.18@tcp:101:rm.0 Request processed in 417us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.898006:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:1.0:1789024059.903014:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024059.908537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402308224 00000100:00100000:2.0:1789024059.908555:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402308224 00000100:00100000:3.0:1789024059.909073:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:3.0:1789024059.909086:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:10503:x1875927402308224:12345-192.168.202.18@tcp:101:rm.0 00010000:00010000:3.0:1789024059.909106:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.909130:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af44d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.909607:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789024059.909759:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3865 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af44d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.909774:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:3.0:1789024059.909777:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789024059.909783:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af44d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.909796:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00100000:3.0:1789024059.909880:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+15:10503:x1875927402308224:12345-192.168.202.18@tcp:101:rm.0 Request processed in 797us (6876us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1789024059.909889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:0.0:1789024059.929733:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024059.929852:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402308352 00000100:00100000:2.0:1789024059.929867:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402308352 00000100:00100000:2.0:1789024059.929932:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024059.929945:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+15:10503:x1875927402308352:12345-192.168.202.18@tcp:37:rm.0 00000100:00100000:2.0:1789024059.939603:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+15:10503:x1875927402308352:12345-192.168.202.18@tcp:37:rm.0 Request processed in 9650us (9872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024059.941105:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:1.0:1789024059.950298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.950989:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402308608 00000100:00100000:3.0:1789024059.951003:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402308608 00000100:00100000:3.0:1789024059.951200:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:3.0:1789024059.951221:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+15:10503:x1875927402308608:12345-192.168.202.18@tcp:35:rm.0 00000100:00100000:3.0:1789024059.952011:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+16:10503:x1875927402308608:12345-192.168.202.18@tcp:35:rm.0 Request processed in 799us (1719us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789024059.952020:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:0.0:1789024059.956503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.956603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402308864 00000100:00100000:3.0:1789024059.956614:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402308864 00000100:00100000:3.0:1789024059.956739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:3.0:1789024059.956750:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+16:10503:x1875927402308864:12345-192.168.202.18@tcp:101:rm.0 00010000:00010000:3.0:1789024059.956776:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.956798:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af454 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.956914:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb387a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.956930:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb387a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.956942:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb387a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.956954:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789024059.957280:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af454 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.957303:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb387a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af454 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.957311:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024059.957314:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024059.957318:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4e00, rc 0) 00000100:00100000:3.0:1789024059.957396:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402308864:12345-192.168.202.18@tcp:101:rm.0 Request processed in 649us (1078us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789024059.957404:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:0.0:1789024059.960905:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.961019:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402308992 00000100:00100000:1.0:1789024059.961030:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402308992 00000100:00100000:3.0:1789024059.961184:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:3.0:1789024059.961197:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402308992:12345-192.168.202.18@tcp:41:rm.0 00000004:00000024:3.0:1789024059.961266:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789024059.961329:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402308992:12345-192.168.202.18@tcp:41:rm.0 Request processed in 134us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.961348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:1.0:1789024059.967959:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.968058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402309120 00000100:00100000:3.0:1789024059.968070:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402309120 00000100:00100000:3.0:1789024059.968135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:3.0:1789024059.968188:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402309120:12345-192.168.202.18@tcp:101:rm.0 00010000:00010000:3.0:1789024059.968210:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024059.968242:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3888 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af45b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968315:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968565:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968579:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968593:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968600:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968606:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968810:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968819:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968826:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024059.968863:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789024059.968868:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024059.968888:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968899:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968918:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968925:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968931:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968938:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.968942:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968950:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968961:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024059.968965:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.968970:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968976:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb388f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968989:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.968996:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969001:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969015:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024059.969017:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969023:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969485:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff90cc35213100) 00010000:00010000:3.0:1789024059.969491:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024059.969496:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969502:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3896 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969537:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3888 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af45b expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969553:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af45b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024059.969572:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:3.0:1789024059.969575:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024059.969578:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488800, rc 0) 00000100:00100000:3.0:1789024059.969789:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:10503:x1875927402309120:12345-192.168.202.18@tcp:101:rm.0 Request processed in 1644us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024059.969799:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:0.0:1789024059.980518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024059.980794:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402309376 00000100:00100000:3.0:1789024059.980819:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402309376 00000100:00100000:0.0:1789024059.981066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:0.0:1789024059.981078:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+19:10503:x1875927402309376:12345-192.168.202.18@tcp:36:rm.0 00010000:00010000:0.0:1789024059.981138:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789024059.981369:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb389d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af45b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981395:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3849 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af43f expref: 18 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981407:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:0.0:1789024059.981417:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb385e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af446 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981426:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:0.0:1789024059.981429:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024059.981450:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981475:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981486:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981492:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981508:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981748:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981759:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.981765:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024059.982475:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789024059.982489:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378018341385ns, next at 379018339113ns, rc = 0 00010000:00010000:0.0:1789024059.982541:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982551:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982560:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982641:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982649:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982728:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982810:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024059.982843:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982850:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982857:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982863:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024059.982868:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982877:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982890:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:0.0:1789024059.982893:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789024059.982898:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982906:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb38b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982926:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982933:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982938:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982950:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fc00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024059.982954:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982960:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982969:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:0.0:1789024059.982971:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024059.982974:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.982992:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fc00/0xa736ef4b98cb38a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024059.983002:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058bd391c reply state 00000000892c94ff transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.983014:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024059.983020:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff90cc35213100) 00010000:00010000:0.0:1789024059.983022:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789024059.983026:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789024059.983130:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402309376:12345-192.168.202.18@tcp:36:rm.0 Request processed in 2051us (2620us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789024059.983139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:1.0:1789024059.988400:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024059.988498:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402309632 00000100:00100000:0.0:1789024059.988509:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402309632 00000100:00100000:0.0:1789024059.988560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:0.0:1789024059.988773:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402309632:12345-192.168.202.18@tcp:35:rm.0 00010000:00010000:2.0:1789024059.989490:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024059.989502:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.989512:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024059.989517:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.989526:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.989544:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:2.0:1789024059.989546:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789024059.989552:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.989557:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f400/0xa736ef4b98cb38b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024059.989649:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024059.989784:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024059.989787:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024059.989943:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:10503:x1875927402309632:12345-192.168.202.18@tcp:35:rm.0 Request processed in 1286us (1618us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789024059.989954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:3.0:1789024059.992640:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024059.993138:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402309888 00000100:00100000:1.0:1789024059.993486:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402309888 00000100:00100000:1.0:1789024059.993724:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:1.0:1789024059.993737:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:10503:x1875927402309888:12345-192.168.202.18@tcp:36:rm.0 00010000:00010000:1.0:1789024059.993800:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789024059.993828:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb387a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af454 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.993851:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af431 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.993863:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:1.0:1789024059.993879:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb37d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af423 expref: 17 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.993888:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc2d0d7100) 00010000:00010000:1.0:1789024059.993896:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024059.993921:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.993935:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.993946:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994119:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994127:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994134:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994518:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994528:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994534:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024059.994939:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789024059.994959:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.994966:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.995114:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.995120:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024059.995125:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997753:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997779:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90cb032b2400) 00010000:00010000:1.0:1789024059.997783:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789024059.997789:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997797:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb38ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997844:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997851:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997857:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997863:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024059.997866:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997872:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997879:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb032b2200) 00010000:00010000:1.0:1789024059.997882:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024059.997885:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997913:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb38c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024059.997930:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ea323a2 reply state 000000008445973e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997943:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024059.997950:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb032b2e00) 00010000:00010000:1.0:1789024059.997953:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024059.997957:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024059.998960:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:10503:x1875927402309888:12345-192.168.202.18@tcp:36:rm.0 Request processed in 5218us (6323us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789024059.998980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 39 00010000:00010000:1.0:1789024060.237244:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024061.263844:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024061.836574:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024061.836602:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422313856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024061.836702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024061.844929:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313856 00000100:00100000:0.0:1789024061.844945:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313856 00000100:00100000:1.0:1789024061.845036:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789024061.845049:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422313856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024061.845091:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024061.845211:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422313856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (8508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024061.845217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789024061.845564:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422313856:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789024062.284564:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024062.864214:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024062.864238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422313984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024062.864324:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024062.864391:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422313984 00000100:00100000:1.0:1789024062.864412:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422313984 00000100:00100000:1.0:1789024062.864472:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789024062.864481:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422313984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024062.864510:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024062.864571:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422313984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024062.864579:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1789024062.864608:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789024062.864640:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc82a00 x1875927422313984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024062.864659:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422313984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024062.872724:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422314112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024062.872808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789024062.872905:0:8902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380908757427ns, next at 381908754095ns, rc = 0 00000100:00100000:1.0:1789024062.873262:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314112 00000100:00100000:1.0:1789024062.873272:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314112 00000100:00100000:1.0:1789024062.873344:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789024062.873355:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422314112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024062.873378:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789024062.873466:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024062.877355:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422314112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3990us (4534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024062.877371:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789024062.883694:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf34000 x1875927422314112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024062.883731:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422314112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789024063.308497:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024063.372618:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422314368:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372693:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372746:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422314880:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372790:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422315392:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372848:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789024063.372855:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422314496:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372898:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422315008:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372936:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422315520:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.372956:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.372982:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314368 00000100:00100000:1.0:1789024063.372990:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314368 00000100:00100000:1.0:1789024063.373028:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314880 00000100:00100000:1.0:1789024063.373031:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314880 00000100:00100000:1.0:1789024063.373054:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315392 00000100:00100000:1.0:1789024063.373057:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315392 00000100:00100000:1.0:1789024063.373068:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315008 00000100:00100000:1.0:1789024063.373071:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315008 00000100:00100000:1.0:1789024063.373082:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315520 00000100:00100000:1.0:1789024063.373085:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315520 00000100:00100000:1.0:1789024063.373100:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789024063.373108:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422314368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373200:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422314368:12345-0@lo:400:kworker.0 Request processed in 92us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.373207:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789024063.373233:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789024063.373239:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422314880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373269:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422314880:12345-0@lo:400:kworker.0 Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.373275:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789024063.373288:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789024063.373300:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422315392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373329:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422315392:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.373334:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789024063.373347:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789024063.373353:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422315008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373378:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422315008:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.373383:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789024063.373396:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789024063.373403:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422315520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373426:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422315520:12345-0@lo:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.373432:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:1.0:1789024063.373473:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc80000 x1875927422315008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024063.373486:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422315008:0@lo:400:kworker.0 00010000:00080000:1.0:1789024063.373496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa42680 x1875927422315520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024063.373505:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422315520:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373514:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422314368:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422314880:0@lo:400:kworker.0 00000100:00100000:1.0:1789024063.373531:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422315392:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374711:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422314624:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.374797:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.374847:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422315648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.374897:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789024063.374904:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422314240:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.374955:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422314752:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.374980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.375000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422315264:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375020:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.375037:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422315776:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375056:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.375097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314624 00000100:00100000:3.0:1789024063.375104:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314624 00000100:00100000:3.0:1789024063.375167:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789024063.375175:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422314624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375236:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422314624:12345-0@lo:400:kworker.0 Request processed in 62us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789024063.375265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314496 00000100:00100000:3.0:1789024063.375270:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314496 00000100:00100000:3.0:1789024063.375293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314752 00000100:00100000:3.0:1789024063.375295:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314752 00000100:00100000:3.0:1789024063.375311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789024063.375317:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422314496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375357:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422314496:12345-0@lo:400:kworker.0 Request processed in 40us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789024063.375375:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789024063.375381:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422314752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375407:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422314752:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789024063.375439:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315136 00000100:00100000:3.0:1789024063.375443:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315136 00000100:00100000:3.0:1789024063.375465:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315648 00000100:00100000:3.0:1789024063.375468:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315648 00000100:00100000:3.0:1789024063.375483:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315264 00000100:00100000:3.0:1789024063.375485:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315264 00000100:00100000:3.0:1789024063.375495:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315776 00000100:00100000:3.0:1789024063.375497:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315776 00000100:00100000:3.0:1789024063.375522:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789024063.375528:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422315136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375574:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422315136:12345-0@lo:400:kworker.0 Request processed in 46us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375580:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789024063.375592:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789024063.375598:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422315648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375625:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422315648:12345-0@lo:400:kworker.0 Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375631:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789024063.375641:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789024063.375647:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375672:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422315264:12345-0@lo:400:kworker.0 Request processed in 25us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375677:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789024063.375687:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789024063.375693:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422315776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375715:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422315776:12345-0@lo:400:kworker.0 Request processed in 23us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375721:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789024063.375742:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422314240 00000100:00100000:3.0:1789024063.375746:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422314240 00000100:00100000:3.0:1789024063.375769:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789024063.375775:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422314240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375803:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422314240:12345-0@lo:400:kworker.0 Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.375818:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789024063.375876:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422314240:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375888:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422314752:0@lo:400:kworker.0 00010000:00080000:3.0:1789024063.375900:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc80380 x1875927422315264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024063.375910:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422315264:0@lo:400:kworker.0 00010000:00080000:3.0:1789024063.375919:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa40380 x1875927422315776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024063.375927:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422315776:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.375936:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422314624:0@lo:400:kworker.0 00010000:00080000:3.0:1789024063.375946:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bc81c00 x1875927422315136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024063.375953:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422315136:0@lo:400:kworker.0 00010000:00080000:3.0:1789024063.375962:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa43800 x1875927422315648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024063.375970:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422315648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024063.376011:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422314496:0@lo:400:kworker.0 00000100:00080000:2.0:1789024063.376306:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024063.376313:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024063.376316:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024063.376564:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422315904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024063.376612:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024063.376681:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422315904 00000100:00100000:3.0:1789024063.376686:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422315904 00000100:00100000:3.0:1789024063.376717:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789024063.376724:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422315904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024063.376754:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024063.377008:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422316032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024063.377038:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024063.377068:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316032 00000100:00100000:1.0:1789024063.377072:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316032 00000100:00100000:1.0:1789024063.377091:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789024063.377097:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422316032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024063.377107:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024063.377138:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422316032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.377162:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789024063.377218:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ed80 x1875927422316032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024063.377234:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422316032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024063.379267:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422315904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2534us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024063.379281:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1789024063.379387:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc012ae300 x1875927422315904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024063.379407:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422315904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024063.507877:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.507935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.507965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.508002:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.508024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.508058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024063.508092:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310400 00000100:00100000:2.0:1789024063.508103:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310400 00000100:00100000:2.0:1789024063.508230:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:1.0:1789024063.508240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310272 00000100:00100000:2.0:1789024063.508243:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402310400:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024063.508244:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310272 00000100:00100000:1.0:1789024063.508271:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310528 00000100:00100000:1.0:1789024063.508273:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310528 00000100:00100000:1.0:1789024063.508285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310144 00000100:00100000:1.0:1789024063.508288:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310144 00000100:00100000:1.0:1789024063.508299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310656 00000100:00100000:1.0:1789024063.508301:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310656 00000100:00100000:1.0:1789024063.508332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 229 00000100:00100000:1.0:1789024063.508340:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402310272:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024063.508341:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402310400:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024063.508348:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:1.0:1789024063.508373:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402310272:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.508379:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 229 00000100:00100000:1.0:1789024063.508425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 230 00000100:00100000:1.0:1789024063.508431:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402310528:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024063.508457:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402310528:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.508463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 230 00000100:00100000:1.0:1789024063.508474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 231 00000100:00100000:1.0:1789024063.508480:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402310144:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024063.508506:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402310144:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.508511:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 231 00000100:00100000:1.0:1789024063.508524:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 232 00000100:00100000:1.0:1789024063.508530:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402310656:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024063.508555:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402310656:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024063.508561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 232 00000100:00080000:1.0:1789024063.508602:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024063.508606:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024063.508609:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024063.508678:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310016 00000100:00100000:0.0:1789024063.508683:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310016 00000100:00100000:0.0:1789024063.508724:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 340 00000100:00100000:0.0:1789024063.508733:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402310016:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024063.508759:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402310016:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 28us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024063.508764:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 340 00010000:00010000:0.0:1789024064.337440:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789024064.347504:0:13683:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789024064.911853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422316160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024064.911950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024064.912052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316160 00000100:00100000:0.0:1789024064.912063:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316160 00000100:00100000:0.0:1789024064.912139:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789024064.912190:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422316160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024064.912227:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789024064.912740:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422316160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 551us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024064.912750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789024064.912844:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422316160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024065.356614:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789024065.443767:0:13732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd69b4fb00 20000000:00000080:0.0:1789024065.443791:0:13732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb03ac8000 uarg=0000000000000000 20000000:01000000:0.0:1789024065.443836:0:13732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789024065.443842:0:13732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789024065.443846:0:13732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789024065.444596:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789024065.444744:0:13732:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789024065.450919:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789024065.450979:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789024065.450997:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789024065.451017:0:13732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789024065.451038:0:13732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451059:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451066:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451073:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451080:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451089:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451096:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.451103:0:13732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.452130:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.452855:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 12 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.452879:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316288:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024065.453009:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.453018:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 12 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.453026:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316416:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024065.453079:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.453087:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 23 pid: 6508 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.453095:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316544:0@lo:104: 00000100:00100000:0.0:1789024065.453138:0:13732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024065.462384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024065.462444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024065.462478:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310784 00000100:00100000:3.0:1789024065.462489:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310784 00010000:00010000:3.0:1789024065.462541:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 13 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024065.462646:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402310912 00000100:00100000:3.0:1789024065.462650:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402310912 00010000:00010000:3.0:1789024065.462666:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 14 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024065.462691:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:3.0:1789024065.462703:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14ec32b5-f959-4605-b464-02aeac6020b2+14:2402:x1875927402310784:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024065.462721:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024065.462727:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 14 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.462739:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 14 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.462762:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024065.462817:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14ec32b5-f959-4605-b464-02aeac6020b2+14:2402:x1875927402310784:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 117us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024065.462845:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:3.0:1789024065.462865:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:3.0:1789024065.462871:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402310912:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024065.462879:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024065.462884:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 13 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.462894:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 13 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.462904:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024065.462923:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402310912:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 52us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024065.462929:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 47 00010000:00010000:0.0:1789024065.464117:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.464132:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.465054:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316672:0@lo:104: 00010000:00010000:0.0:1789024065.465432:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.465444:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 23 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.465453:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316800:0@lo:104: 00010000:00010000:0.0:1789024065.465485:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.465493:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 23 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.465500:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316928:0@lo:104: 00000100:00100000:0.0:1789024065.465519:0:13732:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596600 going to sleep for 11 seconds 00010000:00010000:0.0:1789024065.465551:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4000/0xa736ef4b98cb37a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af415 expref: 12 pid: 6509 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.465564:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316288:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024065.465576:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb379a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af40e expref: 11 pid: 6508 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024065.465585:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c14e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316416:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024065.465901:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789024065.465931:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024065.466006:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024065.466071:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024065.466091:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316544 00000100:00100000:2.0:1789024065.466101:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316544 00000100:00100000:2.0:1789024065.466199:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316672 00000100:00100000:2.0:1789024065.466203:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316672 00000100:00100000:2.0:1789024065.466218:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316800 00000100:00100000:2.0:1789024065.466233:0:6499:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316800 00000100:00100000:2.0:1789024065.466251:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789024065.466258:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f961850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:13732:x1875927422316544:12345-0@lo:104: 00010000:00010000:2.0:1789024065.466272:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.466537:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024065.466545:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f961850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+5:13732:x1875927422316544:12345-0@lo:104: Request processed in 287us (13407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024065.466552:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789024065.466594:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789024065.466601:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:13732:x1875927422316672:12345-0@lo:104: 00010000:00010000:2.0:1789024065.466609:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467602:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024065.467611:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467621:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024065.467626:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467635:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024065.467655:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024065.467680:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789024065.467740:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467747:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024065.467774:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467781:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a54e00/0xa736ef4b98cb378c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3793 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.467796:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024065.467798:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024065.467800:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024065.468311:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024065.468322:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+4:13732:x1875927422316672:12345-0@lo:104: Request processed in 1717us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024065.468517:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316544:0@lo:104: 00000100:00100000:0.0:1789024065.468528:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316672:0@lo:104: 00000100:00100000:2.0:1789024065.468575:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789024065.468612:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789024065.468622:0:6499:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:13732:x1875927422316800:12345-0@lo:104: 00010000:00010000:2.0:1789024065.468633:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468682:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789024065.468688:0:6499:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2a60d918-c836-4e5c-bd08-febd347ea726+3:13732:x1875927422316800:12345-0@lo:104: Request processed in 70us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024065.468693:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789024065.468729:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422317056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024065.468770:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789024065.468824:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789024065.468830:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468837:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024065.468841:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468847:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024065.468854:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024065.468858:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789024065.468880:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468886:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024065.468906:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468914:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a54800/0xa736ef4b98cb377e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3785 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468922:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024065.468925:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468941:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024065.468945:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468952:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024065.468958:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024065.468963:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789024065.468977:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468982:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024065.468988:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.468994:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5400/0xa736ef4b98cb3770 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3777 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.469003:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024065.469005:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024065.469006:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024065.469019:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317056 00000100:00100000:2.0:1789024065.469025:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317056 00010000:00010000:2.0:1789024065.469049:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024065.469074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789024065.469087:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422317056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789024065.469098:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024065.469103:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.469113:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.469127:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1800/0xa736ef4b98cb3793 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb378c expref: 24 pid: 6508 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024065.469138:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024065.469215:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+23:3644:x1875927422317056:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024065.469221:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789024065.469240:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422317184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024065.469264:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024065.469288:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024065.469293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422317312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024065.469312:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024065.469451:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024065.469600:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316800:0@lo:104: 00000100:00100000:1.0:1789024065.469743:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422316928 00000100:00100000:1.0:1789024065.469748:0:6498:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422316928 00000100:00100000:1.0:1789024065.469787:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789024065.469802:0:6498:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:13732:x1875927422316928:12345-0@lo:104: 00010000:00010000:1.0:1789024065.469812:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.469855:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789024065.469860:0:6498:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2a60d918-c836-4e5c-bd08-febd347ea726+3:13732:x1875927422316928:12345-0@lo:104: Request processed in 60us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024065.469866:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789024065.469890:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024065.469895:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.469902:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024065.469905:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.469912:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024065.469919:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024065.469924:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789024065.469946:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.469952:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:0.0:1789024065.470113:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:1.0:1789024065.470343:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.470363:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb3762 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb3769 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.470380:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024065.470382:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024065.470383:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789024065.470560:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789024065.470572:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789024065.470614:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875927422316928:0@lo:104: 00010000:00010000:0.0:1789024065.470651:0:13732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024065.470729:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317184 00000100:00100000:2.0:1789024065.470734:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317184 00010000:00010000:2.0:1789024065.470758:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 23 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024065.470815:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317312 00000100:00100000:2.0:1789024065.470819:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317312 00010000:00010000:2.0:1789024065.470832:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 24 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024065.470879:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789024065.470889:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422317184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024065.470899:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024065.470904:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 24 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.470914:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 24 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.470927:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb3785 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb377e expref: 24 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.470939:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024065.471000:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+23:3641:x1875927422317184:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024065.471015:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789024065.471031:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789024065.471037:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+22:3641:x1875927422317312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024065.471045:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024065.471049:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 22 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.471057:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 22 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.471066:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1c00/0xa736ef4b98cb3777 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3770 expref: 22 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.471074:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024065.471097:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3641:x1875927422317312:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024065.471102:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789024065.471281:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471291:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471298:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471304:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024065.471308:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471315:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471339:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff90cc35213100) 00010000:00010000:1.0:1789024065.471342:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024065.471346:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471353:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1e00/0xa736ef4b98cb382d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471378:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471384:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471390:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471395:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024065.471399:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471405:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471413:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90cc35213900) 00010000:00010000:1.0:1789024065.471416:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024065.471419:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471425:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3842 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471440:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471446:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471452:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471462:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024065.471465:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471471:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471479:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff90cc35213100) 00010000:00010000:1.0:1789024065.471481:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024065.471483:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471489:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb38ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471506:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471512:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471517:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471522:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024065.471525:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471531:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471549:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90cb032b2e00) 00010000:00010000:1.0:1789024065.471551:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024065.471553:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.471559:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55e00/0xa736ef4b98cb38c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024065.471733:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422317568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789024065.471778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024065.471822:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422317056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024065.471839:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024065.471845:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422317440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024065.471870:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024065.471904:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317440 00000100:00100000:3.0:1789024065.471909:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317440 00010000:00010000:3.0:1789024065.471927:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024065.471958:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789024065.471965:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024065.471975:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024065.471979:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.471988:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.471998:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0400/0xa736ef4b98cb3769 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb3762 expref: 21 pid: 6509 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472011:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472019:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472035:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472041:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472046:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472052:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472065:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ec00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024065.472068:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472074:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472087:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024065.472097:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024065.472127:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a60d918-c836-4e5c-bd08-febd347ea726+20:3644:x1875927422317440:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024065.472134:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789024065.472276:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422317440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024065.472385:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422317312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024065.472395:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422317184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024065.472437:0:13732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.472446:0:13732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024065.472451:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252ec00/0xa736ef4b98cb38d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024065.473640:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317568 00000100:00100000:1.0:1789024065.473653:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317568 00000100:00100000:1.0:1789024065.473721:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789024065.473732:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422317568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789024065.473769:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789024065.473809:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa2573c, atime: 0x6aa2573c, ctime: 0x6aa2573c, blocks: 0x0 00010000:00010000:1.0:1789024065.473818:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.473836:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1789024065.473842:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024065.473849:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.473885:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.473898:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.473921:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.473942:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789024065.474139:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422317568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 409us (2361us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789024065.474445:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789024065.474494:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024065.474501:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.474511:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024065.474516:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.474526:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.474548:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.474556:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd1d278c/0xa736ef4b98cb38dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024065.474573:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024065.474582:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024065.474584:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789024065.474624:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cc012ae300/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789024065.474630:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422317568:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789024065.475859:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789024066.323017:0:13781:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe28a792e0 20000000:00000080:3.0:1789024066.323039:0:13781:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb03b03800 uarg=0000000000000000 20000000:01000000:3.0:1789024066.323091:0:13781:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789024066.323098:0:13781:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789024066.323103:0:13781:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789024066.323789:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789024066.323953:0:13781:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789024066.324099:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789024066.324127:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789024066.324141:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789024066.324239:0:13781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789024066.324262:0:13781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324291:0:13781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324302:0:13781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324309:0:13781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324316:0:13781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324323:0:13781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324329:0:13781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024066.324333:0:13781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324340:0:13781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324353:0:13781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324361:0:13781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.324367:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.380344:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789024066.764737:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024066.764746:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb021fb800 from 7 10000000:01000000:1.0:1789024066.764752:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024066.764808:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.764822:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.764835:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024066.764865:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.764941:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.765020:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.765293:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317696 00000100:00100000:2.0:1789024066.765303:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317696 00000100:00100000:2.0:1789024066.765361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789024066.765371:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+20:6512:x1875927422317696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024066.765385:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024066.765399:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1e00/0xa736ef4b98cb38f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb38ea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.765423:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1e00/0xa736ef4b98cb38f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb38ea expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.765433:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1e00/0xa736ef4b98cb38f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb38ea expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.765443:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1e00, rc 0) 00000100:00100000:2.0:1789024066.765622:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422317696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.765628:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789024066.765776:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024066.765790:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.765798:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024066.765862:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.765891:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.765944:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789024066.766010:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317824 00000100:00100000:3.0:1789024066.766015:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317824 00000100:00100000:3.0:1789024066.766051:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789024066.766058:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422317824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024066.766236:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422317824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024066.766243:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789024066.766430:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.766473:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.766527:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.766554:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.766665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422317952 00000100:00100000:2.0:1789024066.766670:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422317952 00000100:00100000:2.0:1789024066.766703:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789024066.766711:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422317952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024066.766811:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422317952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.766818:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789024066.767309:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422317952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.768750:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13794:1875927422318080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024066.768833:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.768879:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596000 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.768945:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318080 00000100:00100000:2.0:1789024066.768952:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318080 00000100:00100000:2.0:1789024066.769007:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789024066.769016:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:13794:x1875927422318080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024066.769697:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:13794:x1875927422318080:12345-0@lo:502:llog_process_th.0 Request processed in 679us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.769706:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789024066.773258:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13794:1875927422318080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.773314:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.773328:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.773342:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.773349:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb021fb800 00000020:00000080:0.0:1789024066.773352:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789024066.773428:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.773432:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.773434:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.773436:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.773439:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.773440:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789024066.773444:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb021fb800 00000020:00000080:0.0:1789024066.773446:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789024066.775324:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13794:1875927422318208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024066.775413:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.775454:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596000 going to sleep for 11 seconds 00000100:00100000:1.0:1789024066.775955:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318208 00000100:00100000:1.0:1789024066.775967:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318208 00000100:00100000:1.0:1789024066.776021:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789024066.776031:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:13794:x1875927422318208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024066.776241:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+21:13794:x1875927422318208:12345-0@lo:502:llog_process_th.0 Request processed in 210us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.776250:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789024066.776631:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13794:1875927422318208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.776665:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.776672:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.776675:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789024066.776679:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789024066.777643:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789024066.777693:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024066.777707:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.777721:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024066.777733:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024066.777736:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc3bd3a000 from 7 10000000:01000000:1.0:1789024066.777739:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024066.777778:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.777787:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.777811:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024066.777837:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.785736:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.785785:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024066.789371:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318336 00000100:00100000:3.0:1789024066.789388:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318336 00000100:00100000:3.0:1789024066.789450:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789024066.789462:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+21:6512:x1875927422318336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024066.789483:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024066.796309:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb38f8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.796348:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb38f8 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.796358:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb38f8 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024066.796366:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489e00, rc 0) 00000100:00100000:3.0:1789024066.796453:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6992us (10722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024066.796462:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789024066.796952:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789024066.796974:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.796986:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024066.797084:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.797123:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.797192:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596000 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.797395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318464 00000100:00100000:2.0:1789024066.797403:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318464 00000100:00100000:2.0:1789024066.797453:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789024066.797478:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024066.797624:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.797631:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789024066.802219:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.802301:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.802400:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.802444:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596000 going to sleep for 11 seconds 00000100:00100000:3.0:1789024066.802642:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318592 00000100:00100000:3.0:1789024066.802651:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318592 00000100:00100000:3.0:1789024066.802709:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789024066.802718:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024066.802853:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024066.802862:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789024066.802913:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024066.806758:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13797:1875927422318720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789024066.806844:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024066.806880:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3f90a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.806936:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318720 00000100:00100000:2.0:1789024066.806944:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318720 00000100:00100000:2.0:1789024066.806996:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789024066.807006:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:13797:x1875927422318720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024066.807188:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+22:13797:x1875927422318720:12345-0@lo:502:llog_process_th.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.807197:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789024066.807412:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13797:1875927422318720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.807442:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.807452:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.807455:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.807472:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc3bd3a000 00000020:00000080:0.0:1789024066.807475:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789024066.807548:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.807552:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.807553:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.807556:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.807558:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.807559:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789024066.807562:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc3bd3a000 00000020:00000080:0.0:1789024066.807564:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789024066.807599:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13797:1875927422318848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024066.807638:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.807658:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596780 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.808481:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318848 00000100:00100000:2.0:1789024066.808490:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318848 00000100:00100000:2.0:1789024066.811294:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789024066.811322:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:13797:x1875927422318848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024066.811545:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:13797:x1875927422318848:12345-0@lo:502:llog_process_th.0 Request processed in 236us (3905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.811554:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789024066.811714:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13797:1875927422318848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.811752:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.811761:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.811764:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789024066.811769:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789024066.811845:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789024066.811873:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789024066.811893:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.811905:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024066.811917:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789024066.811920:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc414b7800 from 7 10000000:01000000:0.0:1789024066.811923:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789024066.811956:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.811963:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.811972:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024066.811994:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.812037:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.820991:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596780 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.824362:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422318976 00000100:00100000:2.0:1789024066.824382:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422318976 00000100:00100000:2.0:1789024066.826269:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789024066.826297:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+22:6512:x1875927422318976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024066.826316:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024066.826337:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb390d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3906 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.826366:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb390d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3906 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.826378:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb390d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3906 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024066.826386:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1200, rc 0) 00000100:00100000:2.0:1789024066.827773:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422318976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1482us (15727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.827784:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789024066.827949:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422318976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789024066.827975:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.827987:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024066.828089:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.828194:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.828212:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35596780 going to sleep for 11 seconds 00000040:00080000:0.0:1789024066.829001:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789024066.829180:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319104 00000100:00100000:2.0:1789024066.829189:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319104 00000100:00100000:2.0:1789024066.829225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789024066.829234:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422319104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024066.830208:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422319104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 970us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.830218:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789024066.831326:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c16680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.831393:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.831487:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.831684:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024066.839620:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319232 00000100:00100000:3.0:1789024066.839635:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319232 00000100:00100000:1.0:1789024066.840608:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789024066.840620:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422319232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.840801:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422319232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (9312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.840809:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789024066.840986:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.852725:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13799:1875927422319360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024066.852836:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.852894:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024066.852948:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319360 00000100:00100000:1.0:1789024066.852957:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319360 00000100:00100000:1.0:1789024066.853002:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789024066.853012:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:13799:x1875927422319360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024066.853290:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+23:13799:x1875927422319360:12345-0@lo:502:llog_process_th.0 Request processed in 278us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.853297:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789024066.853384:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13799:1875927422319360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.853410:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.853420:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.853422:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.853429:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc414b7800 00000020:00000080:0.0:1789024066.853432:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789024066.853510:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.853513:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.853515:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789024066.853517:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024066.853519:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.853521:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789024066.853524:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc414b7800 00000020:00000080:0.0:1789024066.853526:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789024066.853560:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13799:1875927422319488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024066.853596:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024066.853626:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024066.853857:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319488 00000100:00100000:3.0:1789024066.853863:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319488 00000100:00100000:3.0:1789024066.853898:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789024066.853905:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:13799:x1875927422319488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789024066.853979:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+23:13799:x1875927422319488:12345-0@lo:502:llog_process_th.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024066.853986:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789024066.854019:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c15500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13799:1875927422319488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789024066.854035:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024066.854039:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024066.854041:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789024066.854045:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789024066.854352:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789024066.854375:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024066.854391:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.854403:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024066.854415:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024066.854417:0:6512:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc199e6000 from 7 10000000:01000000:1.0:1789024066.854420:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024066.854446:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.854454:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.854474:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024066.854489:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.854646:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.854676:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024066.855207:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319616 00000100:00100000:1.0:1789024066.855213:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319616 00000100:00100000:1.0:1789024066.855239:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789024066.855245:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+23:6512:x1875927422319616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024066.855256:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024066.855268:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb03a54a00/0xa736ef4b98cb391b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb3914 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.855289:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb03a54a00/0xa736ef4b98cb391b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb3914 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.855306:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb03a54a00/0xa736ef4b98cb391b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb3914 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.855315:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54a00, rc 0) 00000100:00100000:1.0:1789024066.855352:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422319616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.855358:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789024066.855399:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024066.855411:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024066.855420:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024066.855487:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.857305:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.859403:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cbf00 going to sleep for 11 seconds 00000040:00080000:2.0:1789024066.863026:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024066.865296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319744 00000100:00100000:0.0:1789024066.865312:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319744 00000100:00100000:0.0:1789024066.865378:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789024066.865389:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422319744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.868349:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422319744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2949us (11038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024066.868368:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789024066.869059:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.869660:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.869952:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.869996:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024066.871965:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422319872 00000100:00100000:2.0:1789024066.871983:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422319872 00000100:00100000:2.0:1789024066.872047:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789024066.872611:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422319872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024066.872793:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:6512:x1875927422319872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 725us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024066.872803:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789024066.872941:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa41180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2a60d918-c836-4e5c-bd08-febd347ea726:6512:1875927422319872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024066.876450:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13802:1875927422320000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024066.877437:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024066.878599:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb020436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024066.879127:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320000 00000100:00100000:1.0:1789024066.879138:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320000 00000100:00100000:1.0:1789024066.879234:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789024066.879245:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:13802:x1875927422320000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024066.879407:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:13802:x1875927422320000:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.879414:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789024066.879765:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13802:1875927422320000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789024066.879805:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024066.879815:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024066.879817:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789024066.879825:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc199e6000 00000020:00000080:2.0:1789024066.879827:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789024066.879889:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024066.879893:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024066.879894:0:13802:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789024066.879897:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024066.879900:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024066.879901:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789024066.879905:0:13802:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc199e6000 00000020:00000080:2.0:1789024066.879907:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789024066.879955:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13802:1875927422320128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024066.879997:0:13802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024066.882502:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789024066.887239:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320128 00000100:00100000:0.0:1789024066.887511:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320128 00000100:00100000:3.0:1789024066.890422:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789024066.890437:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:13802:x1875927422320128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789024066.890644:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:13802:x1875927422320128:12345-0@lo:502:llog_process_th.0 Request processed in 209us (10646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024066.890660:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789024066.890718:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2a60d918-c836-4e5c-bd08-febd347ea726:13802:1875927422320128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789024066.890757:0:13802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024066.890765:0:13802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024066.890767:0:13802:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789024066.890771:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789024066.890834:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789024066.890856:0:6512:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789024066.890867:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.890879:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024066.957339:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024066.957403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024066.957444:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320256 00000100:00100000:1.0:1789024066.957452:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320256 00000100:00100000:1.0:1789024066.957509:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789024066.957519:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422320256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024066.957552:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024066.957610:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422320256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.957617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789024066.957637:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024066.972549:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024066.972727:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311040 00000100:00100000:0.0:1789024066.972739:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311040 00000100:00100000:0.0:1789024066.972810:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 361 00000100:00100000:0.0:1789024066.972820:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+11:6174:x1875927402311040:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789024066.972838:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024066.972872:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252f400/0xa736ef4b98cb3922 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af462 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.972904:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252f400/0xa736ef4b98cb3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af462 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.972916:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252f400/0xa736ef4b98cb3922 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af462 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024066.972925:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f400, rc 0) 00000100:00100000:0.0:1789024066.973029:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311040:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 210us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024066.973036:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 361 00000100:00100000:2.0:1789024066.985359:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024066.985468:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311168 00000100:00100000:1.0:1789024066.985478:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311168 00000100:00100000:1.0:1789024066.985542:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 362 00000100:00100000:1.0:1789024066.985553:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311168:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024066.985728:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311168:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 176us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024066.985736:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 362 00000100:00100000:2.0:1789024066.994581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024066.994757:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311296 00000100:00100000:0.0:1789024066.994769:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311296 00000100:00100000:0.0:1789024066.994829:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 363 00000100:00100000:0.0:1789024066.994839:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311296:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789024066.995389:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311296:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 548us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024066.995399:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 363 00000100:00100000:2.0:1789024066.999615:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024067.000444:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311424 00000100:00100000:1.0:1789024067.000455:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311424 00000100:00100000:1.0:1789024067.000516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 364 00000100:00100000:1.0:1789024067.000525:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:10787:x1875927402311424:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024067.000681:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+12:10787:x1875927402311424:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 153us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024067.000699:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 364 00000100:00100000:2.0:1789024067.011116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024067.011346:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311552 00000100:00100000:0.0:1789024067.011357:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311552 00000100:00100000:0.0:1789024067.011415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 365 00000100:00100000:0.0:1789024067.011427:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:10787:x1875927402311552:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789024067.011662:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+12:10787:x1875927402311552:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 236us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024067.011671:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 365 00000100:00100000:2.0:1789024067.018100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024067.018425:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311680 00000100:00100000:3.0:1789024067.018437:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311680 00000100:00100000:3.0:1789024067.018516:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 366 00000100:00100000:3.0:1789024067.018527:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+12:6174:x1875927402311680:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024067.018550:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024067.018573:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01489a00/0xa736ef4b98cb3929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af469 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024067.018608:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01489a00/0xa736ef4b98cb3929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af469 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024067.018621:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01489a00/0xa736ef4b98cb3929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af469 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024067.018631:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01489a00, rc 0) 00000100:00100000:3.0:1789024067.019435:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402311680:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024067.019444:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 366 00000100:00100000:2.0:1789024067.025533:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024067.026353:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311808 00000100:00100000:0.0:1789024067.026366:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311808 00000100:00100000:0.0:1789024067.026441:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 367 00000100:00100000:0.0:1789024067.026452:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402311808:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789024067.026644:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402311808:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 193us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024067.026652:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 367 00000100:00100000:2.0:1789024067.029727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024067.029821:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402311936 00000100:00100000:3.0:1789024067.029830:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402311936 00000100:00100000:3.0:1789024067.029907:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 368 00000100:00100000:3.0:1789024067.029917:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402311936:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024067.030064:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:6174:x1875927402311936:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 148us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024067.030071:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 368 00000100:00100000:2.0:1789024067.037017:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024067.037222:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312064 00000100:00100000:1.0:1789024067.037232:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312064 00000100:00100000:1.0:1789024067.037299:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 369 00000100:00100000:1.0:1789024067.037312:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:10790:x1875927402312064:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024067.037479:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:10790:x1875927402312064:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 168us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024067.037487:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 369 00000100:00100000:2.0:1789024067.044650:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024067.044757:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312192 00000100:00100000:0.0:1789024067.044767:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312192 00000100:00100000:0.0:1789024067.044822:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 370 00000100:00100000:0.0:1789024067.044832:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:10790:x1875927402312192:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789024067.045464:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:10790:x1875927402312192:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 630us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024067.045473:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 370 00010000:00010000:3.0:1789024067.406256:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024067.853975:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789024067.916994:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024067.980625:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024067.980649:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024067.980723:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024067.981110:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320384 00000100:00100000:2.0:1789024067.981119:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320384 00000100:00100000:2.0:1789024067.981216:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789024067.981227:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422320384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024067.981257:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024067.981305:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422320384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024067.981311:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789024067.981416:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024067.981460:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024067.982447:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422320512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024067.982505:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024067.982579:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320512 00000100:00100000:3.0:1789024067.982586:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320512 00000100:00100000:3.0:1789024067.982640:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789024067.982649:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422320512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024067.982666:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024067.982707:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422320512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024067.982714:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789024067.982760:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024067.982791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422320512:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789024068.428580:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024068.493269:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422320640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024068.493345:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024068.493435:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320640 00000100:00100000:1.0:1789024068.493444:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320640 00000100:00100000:1.0:1789024068.493512:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789024068.493524:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422320640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024068.493591:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024068.493640:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422320640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024068.493647:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1789024068.493701:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038c7800 x1875927422320640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024068.493719:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422320640:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789024068.493932:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024068.495631:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422321152:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.495704:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024068.495757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422321664:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.495779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024068.495801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789024068.495807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422321024:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.495828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024068.495844:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422321536:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.495875:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024068.495892:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422322048:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.495931:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024068.495986:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322048 00000100:00100000:2.0:1789024068.495994:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322048 00000100:00100000:2.0:1789024068.496049:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789024068.496057:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422322048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.496105:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422322048:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024068.496111:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1789024068.496190:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7f800 x1875927422322048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024068.496204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422322048:0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.496485:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321664 00000100:00100000:0.0:1789024068.496490:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321664 00000100:00100000:0.0:1789024068.496533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321024 00000100:00100000:0.0:1789024068.496536:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321024 00000100:00100000:0.0:1789024068.496550:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321536 00000100:00100000:0.0:1789024068.496552:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321536 00000100:00100000:0.0:1789024068.496568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789024068.496575:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422321664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.496616:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422321664:12345-0@lo:400:kworker.0 Request processed in 42us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.496622:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789024068.496637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789024068.496643:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422321024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.496669:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422321024:12345-0@lo:400:kworker.0 Request processed in 27us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.496675:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789024068.496686:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789024068.496692:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422321536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.496715:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422321536:12345-0@lo:400:kworker.0 Request processed in 25us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.496720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:0.0:1789024068.496738:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024068.496742:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024068.496744:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024068.497304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422320896:0@lo:400:kworker.0 00000100:00100000:1.0:1789024068.497344:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024068.497441:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321152 00000100:00100000:3.0:1789024068.497447:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321152 00000100:00100000:3.0:1789024068.497481:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789024068.497487:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422321152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497527:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422321152:12345-0@lo:400:kworker.0 Request processed in 41us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024068.497533:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789024068.497572:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024068.497599:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024068.497627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024068.497666:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422321792:0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497685:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024068.497713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321280 00000100:00100000:3.0:1789024068.497718:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321280 00000100:00100000:3.0:1789024068.497754:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321792 00000100:00100000:3.0:1789024068.497758:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321792 00000100:00100000:3.0:1789024068.497780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789024068.497798:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422321280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497844:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422321280:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024068.497865:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789024068.497879:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789024068.497884:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422321792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497908:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422321792:12345-0@lo:400:kworker.0 Request processed in 25us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024068.497914:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789024068.497951:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422321280:0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.497960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422321792:0@lo:400:kworker.0 00000100:00080000:3.0:1789024068.497984:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024068.498272:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422321408:0@lo:400:kworker.0 00000100:00100000:1.0:1789024068.498300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024068.498323:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422321920:0@lo:400:kworker.0 00000100:00100000:1.0:1789024068.498342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024068.498369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321920 00000100:00100000:1.0:1789024068.498373:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321920 00000100:00100000:1.0:1789024068.498400:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789024068.498406:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422321920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024068.498438:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422321920:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024068.498443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:1.0:1789024068.498468:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789024068.498485:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7e680 x1875927422321920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024068.498495:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422321920:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.498912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320768 00000100:00100000:2.0:1789024068.498917:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320768 00000100:00100000:2.0:1789024068.498955:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789024068.498963:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422320768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024068.498980:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024068.499023:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422320768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024068.499029:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1789024068.499056:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974000 x1875927422320768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024068.499071:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422320768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024068.499113:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422321024:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.499126:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422321536:0@lo:400:kworker.0 00000100:00100000:2.0:1789024068.499167:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422321152:0@lo:400:kworker.0 00010000:00080000:2.0:1789024068.499196:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7d880 x1875927422321664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024068.499205:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422321664:0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.499276:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422321408 00000100:00100000:3.0:1789024068.499280:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422321408 00000100:00100000:3.0:1789024068.499309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789024068.499315:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422321408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.499354:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422321408:12345-0@lo:400:kworker.0 Request processed in 39us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024068.499360:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789024068.499384:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422321408:0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.505198:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422320896 00000100:00100000:0.0:1789024068.505218:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422320896 00000100:00100000:0.0:1789024068.505504:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789024068.505516:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024068.505636:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422320896:12345-0@lo:400:kworker.0 Request processed in 123us (8291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.505644:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789024068.505846:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422320896:0@lo:400:kworker.0 00000100:00100000:3.0:1789024068.632237:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024068.632284:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024068.632319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024068.632363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024068.632523:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312320 00000100:00100000:0.0:1789024068.632532:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312320 00000100:00100000:0.0:1789024068.632601:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 372 00000100:00100000:0.0:1789024068.632610:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402312320:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024068.632683:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402312320:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 73us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.632690:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 372 00000100:00100000:1.0:1789024068.634521:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312704 00000100:00100000:1.0:1789024068.634533:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312704 00000100:00100000:1.0:1789024068.634619:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:1.0:1789024068.634629:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312704:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024068.634700:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312704:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 74us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024068.634705:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00080000:3.0:1789024068.634727:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024068.634740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312448 00000100:00100000:1.0:1789024068.634745:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312448 00000100:00100000:3.0:1789024068.636906:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312576 00000100:00100000:3.0:1789024068.636922:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312576 00000100:00080000:2.0:1789024068.636951:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024068.636957:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024068.636970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 239 00000100:00100000:2.0:1789024068.636983:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 240 00000100:00100000:3.0:1789024068.636985:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312448:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024068.636994:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312576:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024068.637063:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312576:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 74us (4745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024068.637068:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 240 00000100:00100000:3.0:1789024068.640807:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2401:x1875927402312448:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 3812us (8507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024068.640824:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 239 00000100:00100000:2.0:1789024068.644167:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024068.644224:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024068.645110:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312960 00000100:00100000:1.0:1789024068.645121:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312960 00000100:00100000:1.0:1789024068.645235:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402312832 00000100:00100000:1.0:1789024068.645239:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402312832 00000100:00100000:1.0:1789024068.645266:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 241 00000100:00100000:1.0:1789024068.645275:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402312960:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024068.645626:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 242 00000100:00100000:0.0:1789024068.645637:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402312832:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024068.645681:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402312832:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 46us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024068.645688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 242 00000100:00080000:2.0:1789024068.647190:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024068.647201:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024068.647335:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402312960:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 1962us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024068.647346:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 241 00010000:00010000:1.0:1789024069.452548:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024070.028614:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422322176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024070.028709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024070.029095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322176 00000100:00100000:3.0:1789024070.029107:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322176 00000100:00100000:3.0:1789024070.029213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789024070.029224:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422322176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024070.029265:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789024070.029338:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422322176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024070.029344:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789024070.029666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422322176:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024070.480026:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789024071.054337:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1789024071.500370:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024072.076487:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024072.076521:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422322304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024072.076623:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024072.076756:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322304 00000100:00100000:2.0:1789024072.076768:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322304 00000100:00100000:2.0:1789024072.076839:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789024072.076850:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422322304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024072.076899:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024072.076983:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422322304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024072.076991:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789024072.077135:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422322304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024072.531789:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024073.101405:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc30c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024073.101563:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024073.101930:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322432 00000100:00100000:0.0:1789024073.101952:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322432 00000100:00100000:0.0:1789024073.102058:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789024073.102072:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422322432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024073.102137:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024073.102247:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422322432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024073.102287:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1789024073.105056:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024073.105217:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789024073.105239:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cc012ae300, transno 4294967301 00000100:00100000:3.0:1789024073.105316:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc30c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024073.108130:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422322560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024073.109362:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024073.113905:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322560 00000100:00100000:1.0:1789024073.113930:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322560 00000100:00100000:1.0:1789024073.114175:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789024073.114189:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422322560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024073.114225:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024073.114425:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422322560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 239us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024073.114434:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1789024073.114591:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024073.117834:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422322560:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789024073.548585:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024073.612808:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024073.612841:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422322688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024073.612956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024073.613310:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322688 00000100:00100000:0.0:1789024073.613322:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322688 00000100:00100000:0.0:1789024073.613403:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789024073.613416:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422322688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789024073.613482:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024073.613547:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422322688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024073.613555:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1789024073.613759:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024073.614106:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024073.614126:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422322816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024073.614199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.614494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422323200:0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614536:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.614557:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422323712:0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.614601:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789024073.614606:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422323072:0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614626:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.614645:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422323584:0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614685:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.614714:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323712 00000100:00100000:2.0:1789024073.614722:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323712 00000100:00100000:2.0:1789024073.614783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323072 00000100:00100000:2.0:1789024073.614786:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323072 00000100:00100000:2.0:1789024073.614801:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323584 00000100:00100000:2.0:1789024073.614803:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323584 00000100:00100000:2.0:1789024073.614820:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789024073.614828:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422323712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422323712:12345-0@lo:400:kworker.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.614894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789024073.614911:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789024073.614917:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422323072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.614961:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422323072:12345-0@lo:400:kworker.0 Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.614993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789024073.615005:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789024073.615010:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422323584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.615054:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422323584:12345-0@lo:400:kworker.0 Request processed in 44us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.615060:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789024073.615077:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024073.615081:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024073.615130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422323072:0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.615143:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422323584:0@lo:400:kworker.0 00010000:00080000:2.0:1789024073.615190:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9f9880 x1875927422323712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024073.615203:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422323712:0@lo:400:kworker.0 00000100:00100000:0.0:1789024073.616047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322816 00000100:00100000:0.0:1789024073.616058:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322816 00000100:00100000:0.0:1789024073.616138:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789024073.616181:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422322816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789024073.616207:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024073.616275:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422322816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024073.616282:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1789024073.616562:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024073.616776:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422323328:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.616832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024073.616872:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422323840:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.616898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024073.616941:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789024073.616949:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422322944:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.617004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024073.617872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323328 00000100:00100000:2.0:1789024073.617884:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323328 00000100:00100000:0.0:1789024073.618183:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422322944 00000100:00100000:0.0:1789024073.618189:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422322944 00000100:00100000:0.0:1789024073.618235:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789024073.618246:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024073.618332:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422322944:12345-0@lo:400:kworker.0 Request processed in 87us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024073.618339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789024073.618400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323840 00000100:00100000:0.0:1789024073.618404:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323840 00000100:00100000:0.0:1789024073.618440:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789024073.618446:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422323840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.618785:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422322944:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.618797:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422323456:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.618833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024073.618858:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422323968:0@lo:400:kworker.0 00000100:00100000:1.0:1789024073.618883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024073.618941:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323200 00000100:00100000:1.0:1789024073.618947:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323200 00000100:00100000:1.0:1789024073.618981:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323456 00000100:00100000:1.0:1789024073.618984:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323456 00000100:00100000:1.0:1789024073.618999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789024073.619007:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422323200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024073.619164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422323968 00000100:00100000:3.0:1789024073.619170:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422323968 00000100:00100000:3.0:1789024073.619200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789024073.619207:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422323968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024073.619258:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422323968:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024073.619265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789024073.619288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789024073.619295:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422323456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024073.619330:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422323456:12345-0@lo:400:kworker.0 Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024073.619336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00080000:3.0:1789024073.619395:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9f9f80 x1875927422322816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024073.619422:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422322816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024073.619484:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422323456:0@lo:400:kworker.0 00010000:00080000:3.0:1789024073.619495:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9fa680 x1875927422323968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024073.619503:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422323968:0@lo:400:kworker.0 00000100:00080000:3.0:1789024073.619546:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024073.619562:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789024073.619613:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9f9c00 x1875927422322688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024073.619630:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422322688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024073.620137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789024073.620166:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024073.620227:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422323328:12345-0@lo:400:kworker.0 Request processed in 81us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.620234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789024073.620277:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422323328:0@lo:400:kworker.0 00000100:00100000:0.0:1789024073.621142:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422323840:12345-0@lo:400:kworker.0 Request processed in 2689us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024073.621172:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789024073.621351:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422323200:12345-0@lo:400:kworker.0 Request processed in 2343us (6812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024073.621361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789024073.622546:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422323840:0@lo:400:kworker.0 00000100:00100000:0.0:1789024073.622846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422323200:0@lo:400:kworker.0 00000100:00100000:0.0:1789024073.749388:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024073.749469:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313088 00000100:00100000:3.0:1789024073.749484:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313088 00000100:00100000:3.0:1789024073.749561:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 374 00000100:00100000:3.0:1789024073.749575:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402313088:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024073.749699:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402313088:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 128us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024073.749708:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 374 00000100:00100000:0.0:1789024073.766895:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024073.767039:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024073.777875:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024073.783719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313344 00000100:00100000:2.0:1789024073.783744:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313344 00000100:00100000:2.0:1789024073.783872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313600 00000100:00100000:2.0:1789024073.783878:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313600 00000100:00100000:2.0:1789024073.783931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 249 00000100:00100000:2.0:1789024073.783946:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313344:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024073.784279:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313344:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 335us (17396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.784289:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 249 00000100:00100000:2.0:1789024073.784311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 250 00000100:00100000:2.0:1789024073.784319:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402313600:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024073.784353:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402313600:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 36us (17315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024073.784359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 250 00000100:00080000:1.0:1789024073.785395:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024073.785406:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024073.786943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313216 00000100:00100000:1.0:1789024073.786965:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313216 00000100:00100000:1.0:1789024073.787076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 251 00000100:00100000:1.0:1789024073.787097:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313216:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024073.787229:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313216:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 144us (9369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024073.787237:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 251 00000100:00100000:1.0:1789024073.787340:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024073.787416:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024073.787459:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313472 00000100:00100000:1.0:1789024073.787464:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313472 00000100:00100000:1.0:1789024073.787497:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:1.0:1789024073.787504:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313472:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024073.787537:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313472:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024073.787544:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:1.0:1789024073.787565:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313728 00000100:00100000:1.0:1789024073.787569:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313728 00000100:00100000:1.0:1789024073.787597:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 252 00000100:00100000:1.0:1789024073.787604:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402313728:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024073.787630:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402313728:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024073.787637:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 252 00000100:00080000:0.0:1789024073.788002:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024073.788009:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789024073.788011:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789024074.572636:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024075.148900:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024075.149917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422324096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024075.150020:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024075.154716:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324096 00000100:00100000:3.0:1789024075.154743:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324096 00000100:00100000:3.0:1789024075.154867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789024075.154881:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422324096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024075.154935:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789024075.155062:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422324096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024075.155080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789024075.155723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422324096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024075.596415:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024076.620893:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024077.068829:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789024077.132805:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789024077.199442:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422324224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024077.199519:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024077.205285:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324224 00000100:00100000:3.0:1789024077.205299:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324224 00000100:00100000:3.0:1789024077.205349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789024077.205359:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422324224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024077.205406:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024077.205494:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422324224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (5976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024077.205501:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789024077.205582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422324224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024077.644988:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024078.222640:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422324352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024078.222757:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.222905:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324352 00000100:00100000:3.0:1789024078.222919:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324352 00000100:00100000:3.0:1789024078.222997:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789024078.223245:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422324352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024078.223296:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024078.223357:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422324352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.223365:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789024078.223393:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024078.223586:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422324352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024078.227365:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024078.227398:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422324480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789024078.227535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024078.227909:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324480 00000100:00100000:1.0:1789024078.227923:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324480 00000100:00100000:1.0:1789024078.228004:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789024078.228014:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422324480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024078.228053:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024078.228117:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422324480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.228126:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789024078.228222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bc81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422324480:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789024078.229318:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789024078.668423:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024078.733596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422324864:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422324608:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733782:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422325376:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.733784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024078.733809:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733810:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422325120:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733826:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422325888:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.733831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733846:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422325632:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024078.733873:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789024078.733878:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422324992:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.733880:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789024078.733891:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422324736:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024078.733913:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422325504:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.733914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733929:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422325248:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.733931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.733959:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422325760:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.733979:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024078.734015:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324608 00000100:00100000:3.0:1789024078.734024:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324608 00000100:00100000:1.0:1789024078.734143:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325376 00000100:00100000:3.0:1789024078.734191:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789024078.734201:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.734237:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325376 00000100:00100000:3.0:1789024078.734259:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422324608:12345-0@lo:400:kworker.0 Request processed in 60us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.734266:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789024078.734272:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325632 00000100:00100000:1.0:1789024078.734274:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325632 00000100:00100000:1.0:1789024078.734286:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324992 00000100:00100000:1.0:1789024078.734288:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324992 00000100:00100000:1.0:1789024078.734299:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324736 00000100:00100000:3.0:1789024078.734301:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422324864 00000100:00100000:1.0:1789024078.734301:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324736 00000100:00100000:3.0:1789024078.734303:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422324864 00000100:00100000:1.0:1789024078.734310:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325504 00000100:00100000:1.0:1789024078.734312:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325504 00000100:00100000:3.0:1789024078.734324:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325120 00000100:00100000:1.0:1789024078.734324:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325248 00000100:00100000:3.0:1789024078.734326:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325120 00000100:00100000:1.0:1789024078.734326:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325248 00000100:00100000:3.0:1789024078.734339:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789024078.734344:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422324864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.734385:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422324864:12345-0@lo:400:kworker.0 Request processed in 40us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.734391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789024078.734403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789024078.734409:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422325120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.734417:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789024078.734436:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422325120:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.734453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789024078.734473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789024078.734481:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422325632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.734512:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422325632:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.734518:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789024078.734568:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422325376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.734601:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422325376:12345-0@lo:400:kworker.0 Request processed in 179us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.734607:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789024078.734621:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789024078.734635:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422324992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.734662:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422324992:12345-0@lo:400:kworker.0 Request processed in 28us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.734668:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789024078.734681:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789024078.734687:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789024078.734687:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422324736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.734693:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422325504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.734714:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422324736:12345-0@lo:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.734717:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422325504:12345-0@lo:400:kworker.0 Request processed in 25us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.734720:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789024078.734723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789024078.734731:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789024078.734736:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422325248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.734761:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422325248:12345-0@lo:400:kworker.0 Request processed in 24us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024078.734948:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325888 00000100:00100000:2.0:1789024078.734955:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325888 00000100:00100000:2.0:1789024078.734989:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422325760 00000100:00100000:2.0:1789024078.734993:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422325760 00000100:00100000:2.0:1789024078.735018:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789024078.735026:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422325888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024078.735076:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422325888:12345-0@lo:400:kworker.0 Request processed in 51us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024078.735092:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789024078.735108:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789024078.735114:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422325760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024078.735142:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422325760:12345-0@lo:400:kworker.0 Request processed in 29us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024078.735166:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789024078.735191:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024078.735206:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422326144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024078.735240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789024078.735272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024078.735277:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024078.735279:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024078.735769:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422326016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024078.735809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024078.735845:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326144 00000100:00100000:1.0:1789024078.735850:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326144 00000100:00100000:2.0:1789024078.741180:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422324992:0@lo:400:kworker.0 00000100:00100000:2.0:1789024078.741209:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422325504:0@lo:400:kworker.0 00000100:00100000:2.0:1789024078.741223:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422324864:0@lo:400:kworker.0 00010000:00080000:2.0:1789024078.741242:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7f800 x1875927422325376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024078.741255:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422325376:0@lo:400:kworker.0 00010000:00080000:2.0:1789024078.741269:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ef480 x1875927422325888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024078.741278:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422325888:0@lo:400:kworker.0 00000100:00100000:1.0:1789024078.746642:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326016 00000100:00100000:1.0:1789024078.746669:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326016 00000100:00100000:3.0:1789024078.748206:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789024078.748689:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422324736:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.748715:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422325248:0@lo:400:kworker.0 00010000:00080000:3.0:1789024078.748732:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ed180 x1875927422325760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024078.748745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422325760:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.748756:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422324608:0@lo:400:kworker.0 00000100:00100000:3.0:1789024078.748768:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422325120:0@lo:400:kworker.0 00010000:00080000:3.0:1789024078.748802:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9eea00 x1875927422325632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024078.748811:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422325632:0@lo:400:kworker.0 00000100:00100000:0.0:1789024078.757874:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789024078.758284:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024078.758309:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422326016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789024078.758622:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024078.758803:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422326016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 506us (22991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.758811:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024078.758885:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422326144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024078.758898:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024078.758939:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422326144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1048us (23698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.758957:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1789024078.761940:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9faa00 x1875927422326144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024078.761999:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422326144:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789024078.763489:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf36a00 x1875927422326016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024078.763515:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422326016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024078.875702:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024078.875841:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024078.875971:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313984 00000100:00100000:1.0:1789024078.875986:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313984 00000100:00100000:1.0:1789024078.876098:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 259 00000100:00100000:1.0:1789024078.876111:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313984:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024078.876260:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402313984:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 151us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024078.876269:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 259 00000100:00080000:2.0:1789024078.876354:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024078.877799:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402313856 00000100:00100000:0.0:1789024078.877818:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402313856 00000100:00100000:0.0:1789024078.877875:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 376 00000100:00100000:0.0:1789024078.877885:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402313856:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024078.885736:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402313856:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 7832us (10029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024078.885759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 376 00000100:00100000:3.0:1789024078.892481:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024078.894906:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314240 00000100:00100000:2.0:1789024078.894928:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314240 00000100:00100000:2.0:1789024078.895069:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 74 00000100:00100000:2.0:1789024078.895083:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314240:12345-192.168.202.18@tcp:400:kworker.0 00000100:00080000:0.0:1789024078.895092:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024078.895299:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314240:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 218us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024078.895325:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 74 00000100:00100000:3.0:1789024078.897303:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024078.897537:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314112 00000100:00100000:0.0:1789024078.897551:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314112 00000100:00100000:3.0:1789024078.897645:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024078.897654:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 260 00000100:00100000:0.0:1789024078.897668:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314112:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024078.897703:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00080000:2.0:1789024078.897776:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024078.897807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314368 00000100:00100000:2.0:1789024078.897811:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314368 00000100:00080000:2.0:1789024078.897830:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024078.897851:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314496 00000100:00100000:2.0:1789024078.897854:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314496 00000100:00080000:2.0:1789024078.897865:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024078.897880:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 261 00000100:00100000:2.0:1789024078.897887:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402314368:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024078.898574:0:6517:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789024078.898590:0:6517:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789024078.899072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 262 00000100:00100000:3.0:1789024078.899089:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402314496:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024078.901883:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314112:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 4199us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024078.901904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 260 00000100:00100000:2.0:1789024078.904533:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402314368:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 6629us (6872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024078.904554:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 261 00000100:00100000:3.0:1789024078.907096:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402314496:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 7993us (9374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024078.907202:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 262 00010000:00010000:3.0:1789024079.692812:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024080.272653:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024080.272692:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422326272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024080.272801:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024080.273752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326272 00000100:00100000:3.0:1789024080.273767:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326272 00000100:00100000:3.0:1789024080.273854:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789024080.273867:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422326272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024080.273919:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789024080.274287:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422326272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 420us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024080.274569:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422326272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024080.274710:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00010000:1.0:1789024080.723869:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024081.740486:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024082.317242:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024082.317274:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422326400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024082.317382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024082.319141:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326400 00000100:00100000:3.0:1789024082.319180:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326400 00000100:00100000:3.0:1789024082.319265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789024082.319278:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422326400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024082.319326:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024082.319426:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422326400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024082.319434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789024082.319598:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422326400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789024082.767945:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024083.340740:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024083.340775:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422326528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024083.340878:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024083.341416:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024083.341443:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422326656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024083.341481:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326528 00000100:00100000:0.0:1789024083.341494:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326528 00000100:00100000:1.0:1789024083.341518:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024083.341592:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326656 00000100:00100000:3.0:1789024083.341598:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326656 00000100:00100000:0.0:1789024083.341598:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1789024083.341629:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024083.341689:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422326528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789024083.341730:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024083.341794:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422326528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.342033:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422326528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024083.348497:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789024083.348540:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422326656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024083.348879:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024083.349409:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422326656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 891us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024083.349421:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789024083.349537:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024083.349578:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422326656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789024083.788446:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024083.852416:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024083.852416:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024083.852452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422326912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024083.852452:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024083.855537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422327296:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.856296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024083.856412:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422327040:0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.856490:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326784 00000100:00100000:1.0:1789024083.856502:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326784 00000100:00100000:2.0:1789024083.856541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024083.856577:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024083.856589:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422326784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024083.856628:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024083.856679:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422326784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024083.856687:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024083.856727:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327040 00000100:00100000:1.0:1789024083.856738:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327040 00000100:00100000:2.0:1789024083.856739:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422327552:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.856780:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024083.856786:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789024083.856796:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422327040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.856809:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422328064:0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.856840:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422327040:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024083.856851:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789024083.856854:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789024083.856887:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789024083.856904:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9fa680 x1875927422326784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024083.856931:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422326784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024083.856950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328064 00000100:00100000:1.0:1789024083.856965:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328064 00000100:00100000:2.0:1789024083.856979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422327040:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.857004:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789024083.857014:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422327424:0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.857018:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789024083.857026:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422328064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.861446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024083.861525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422327936:0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.861557:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422328064:12345-0@lo:400:kworker.0 Request processed in 4527us (4703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024083.861573:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789024083.861632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327424 00000100:00100000:1.0:1789024083.861643:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327424 00000100:00100000:1.0:1789024083.861702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789024083.861712:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422327424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.861774:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422327424:12345-0@lo:400:kworker.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024083.861781:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789024083.861818:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024083.861932:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327552 00000100:00100000:1.0:1789024083.861938:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327552 00000100:00100000:0.0:1789024083.862115:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.862173:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422327808:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.862410:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.862468:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789024083.862489:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97800 x1875927422328064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024083.862498:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422328320:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.862508:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422328064:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862535:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024083.862538:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422327424:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862571:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789024083.862580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422327168:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862604:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.862620:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422327680:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862641:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.862658:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422328192:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862680:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.862710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327936 00000100:00100000:0.0:1789024083.862715:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327936 00000100:00100000:0.0:1789024083.862758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327808 00000100:00100000:0.0:1789024083.862762:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327808 00000100:00100000:0.0:1789024083.862780:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327168 00000100:00100000:0.0:1789024083.862782:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327168 00000100:00100000:0.0:1789024083.862794:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327680 00000100:00100000:0.0:1789024083.862796:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327680 00000100:00100000:0.0:1789024083.862814:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789024083.862822:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.862851:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422327296 00000100:00100000:2.0:1789024083.862857:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422327296 00000100:00100000:0.0:1789024083.862876:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422327936:12345-0@lo:400:kworker.0 Request processed in 54us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024083.862908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789024083.862909:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789024083.862929:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422327296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.862935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789024083.862946:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422327808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863001:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422327296:12345-0@lo:400:kworker.0 Request processed in 83us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.863008:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789024083.863038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422327936:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789024083.863073:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422327168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863107:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422327168:12345-0@lo:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.863113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789024083.863128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789024083.863133:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422327680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863206:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422327680:12345-0@lo:400:kworker.0 Request processed in 72us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.863212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789024083.863262:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328320 00000100:00100000:2.0:1789024083.863267:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328320 00000100:00100000:2.0:1789024083.863304:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328192 00000100:00100000:2.0:1789024083.863307:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328192 00000100:00100000:2.0:1789024083.863342:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789024083.863356:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422328320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863397:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422328320:12345-0@lo:400:kworker.0 Request processed in 41us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.863403:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789024083.863424:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789024083.863430:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422328192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.863479:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422327808:12345-0@lo:400:kworker.0 Request processed in 535us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024083.863486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1789024083.863509:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789024083.863513:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024083.863515:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024083.863539:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422327168:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.863549:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422327680:0@lo:400:kworker.0 00000100:00100000:0.0:1789024083.863560:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422327296:0@lo:400:kworker.0 00010000:00080000:0.0:1789024083.863571:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97b80 x1875927422327808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024083.863582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422327808:0@lo:400:kworker.0 00010000:00080000:0.0:1789024083.863591:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038aad80 x1875927422328320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024083.863599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422328320:0@lo:400:kworker.0 00000100:00100000:2.0:1789024083.863767:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422328192:12345-0@lo:400:kworker.0 Request processed in 335us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024083.863774:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1789024083.863810:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb038a8380 x1875927422328192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024083.863828:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422328192:0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.864231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789024083.864245:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422327552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024083.864299:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422327552:12345-0@lo:400:kworker.0 Request processed in 59us (7520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024083.864328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789024083.864553:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422327552:0@lo:400:kworker.0 00000100:00100000:3.0:1789024083.864688:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024083.864891:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422326912 00000100:00100000:0.0:1789024083.864898:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422326912 00000100:00100000:0.0:1789024083.865266:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789024083.865277:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422326912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789024083.865462:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024083.867218:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422326912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1932us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024083.867234:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1789024083.867567:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9edc00 x1875927422326912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024083.867631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422326912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024083.993449:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024083.993513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024083.993564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024083.993607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314752 00000100:00100000:0.0:1789024083.993620:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314752 00000100:00100000:0.0:1789024083.993703:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314880 00000100:00100000:0.0:1789024083.993707:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314880 00000100:00100000:0.0:1789024083.993735:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 269 00000100:00100000:0.0:1789024083.993748:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314752:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024083.993888:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314752:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 142us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024083.993897:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 269 00000100:00100000:0.0:1789024083.993922:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 270 00000100:00100000:0.0:1789024083.993929:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314880:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024083.993971:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402314880:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 42us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024083.993978:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 270 00000100:00080000:0.0:1789024083.994008:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024083.994014:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024083.994356:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402314624 00000100:00100000:3.0:1789024083.994363:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402314624 00000100:00100000:3.0:1789024083.994415:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 378 00000100:00100000:3.0:1789024083.994425:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402314624:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024083.994462:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402314624:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 40us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024083.994468:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 378 00000100:00100000:1.0:1789024084.005099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024084.005205:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024084.005256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024084.005634:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315136 00000100:00100000:3.0:1789024084.005647:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315136 00000100:00100000:3.0:1789024084.005738:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315264 00000100:00100000:3.0:1789024084.005742:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315264 00000100:00100000:3.0:1789024084.005769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 271 00000100:00100000:3.0:1789024084.005782:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315136:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024084.005901:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315136:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 121us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024084.005909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 271 00000100:00100000:3.0:1789024084.005929:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 272 00000100:00100000:3.0:1789024084.005935:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315264:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024084.005962:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315264:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 28us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024084.005968:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 272 00000100:00080000:1.0:1789024084.006238:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024084.006243:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024084.006513:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315008 00000100:00100000:0.0:1789024084.006520:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315008 00000100:00100000:0.0:1789024084.006584:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:0.0:1789024084.006593:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402315008:12345-192.168.202.18@tcp:9:kworker.0 00000020:00000080:0.0:1789024084.006641:0:8904:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3850 00000100:00080000:0.0:1789024084.006652:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cb038ee000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024084.006717:0:8904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789024084.007890:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+2:2399:x1875927402315008:12345-192.168.202.18@tcp:9:kworker.0 Request processed in 1289us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024084.007905:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00010000:00010000:3.0:1789024084.008350:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789024084.008569:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789024084.812424:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024085.388596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422328448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024085.388712:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024085.388952:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328448 00000100:00100000:0.0:1789024085.388964:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328448 00000100:00100000:0.0:1789024085.389077:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789024085.389090:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422328448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024085.389141:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789024085.389702:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422328448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024085.390404:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422328448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1313us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024085.390418:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00010000:00010000:0.0:1789024085.837286:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024086.861943:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024087.308987:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789024087.374917:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024087.436564:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024087.441542:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422328576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024087.441666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024087.441926:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328576 00000100:00100000:2.0:1789024087.441938:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328576 00000100:00100000:2.0:1789024087.442021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789024087.442035:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422328576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024087.442088:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789024087.442180:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422328576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024087.442188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789024087.442408:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422328576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024087.887002:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024088.464284:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422328704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024088.464402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024088.464513:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328704 00000100:00100000:3.0:1789024088.464522:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328704 00000100:00100000:3.0:1789024088.464594:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789024088.464605:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422328704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024088.464645:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024088.464698:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422328704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.464706:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789024088.464735:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024088.464778:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422328704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024088.464850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422328832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024088.464876:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.469235:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328832 00000100:00100000:0.0:1789024088.469254:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328832 00000100:00100000:0.0:1789024088.469354:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789024088.469375:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422328832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024088.469411:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024088.469522:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422328832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (4646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024088.469541:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789024088.469613:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422328832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789024088.469783:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789024088.908427:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024088.972546:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024088.972580:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422328960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024088.972677:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973614:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422329472:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973731:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422329984:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973779:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422330496:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973832:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789024088.973838:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422329088:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973871:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973893:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422329600:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973918:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973937:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422330112:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.973972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.973991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422330624:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974040:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422329216:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974065:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422329728:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974110:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974128:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422330240:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974175:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974208:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789024088.974215:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422329344:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974257:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422329856:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974277:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024088.974558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329472 00000100:00100000:3.0:1789024088.974569:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329472 00000100:00100000:3.0:1789024088.974621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329216 00000100:00100000:3.0:1789024088.974624:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329216 00000100:00100000:3.0:1789024088.974638:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329728 00000100:00100000:3.0:1789024088.974642:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329728 00000100:00100000:3.0:1789024088.974670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330240 00000100:00100000:3.0:1789024088.974673:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330240 00000100:00100000:1.0:1789024088.974681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329088 00000100:00100000:3.0:1789024088.974687:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329856 00000100:00100000:1.0:1789024088.974688:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329088 00000100:00100000:3.0:1789024088.974693:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329856 00000100:00100000:3.0:1789024088.974723:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789024088.974736:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422329472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.974738:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789024088.974752:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422329088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.974813:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422329088:12345-0@lo:400:kworker.0 Request processed in 64us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.974821:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789024088.974833:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422330368:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974866:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024088.974903:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330368 00000100:00100000:1.0:1789024088.974906:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422329088:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.974908:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330368 00000100:00100000:3.0:1789024088.975041:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422329472:12345-0@lo:400:kworker.0 Request processed in 309us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.975058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789024088.975075:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789024088.975081:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422329216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024088.975118:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422329216:12345-0@lo:400:kworker.0 Request processed in 38us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.975125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789024088.975140:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789024088.975170:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422329728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024088.975201:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422329728:12345-0@lo:400:kworker.0 Request processed in 56us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.975208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789024088.975220:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789024088.975227:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422330240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024088.975256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422330240:12345-0@lo:400:kworker.0 Request processed in 29us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.975263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789024088.975277:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789024088.975281:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422329472:0@lo:400:kworker.0 00000100:00100000:3.0:1789024088.975288:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422329856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.975400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789024088.975407:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422330368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.975440:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422330368:12345-0@lo:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024088.975447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789024088.975474:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329984 00000100:00100000:0.0:1789024088.975479:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329984 00000100:00100000:3.0:1789024088.975587:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422329856:12345-0@lo:400:kworker.0 Request processed in 303us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024088.975594:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:3.0:1789024088.975612:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024088.975616:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024088.976345:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330496 00000100:00100000:0.0:1789024088.976355:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330496 00000100:00100000:2.0:1789024088.977506:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422328960 00000100:00100000:2.0:1789024088.977520:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422328960 00000100:00100000:2.0:1789024088.979141:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789024088.979173:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422328960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024088.979221:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024088.979328:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422328960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (6652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024088.979335:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789024088.979876:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330112 00000100:00100000:1.0:1789024088.979887:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330112 00000100:00100000:1.0:1789024088.979950:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330624 00000100:00100000:1.0:1789024088.979955:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330624 00000100:00100000:1.0:1789024088.979980:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789024088.979990:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422329984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.980051:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422329984:12345-0@lo:400:kworker.0 Request processed in 64us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.980058:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789024088.980077:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789024088.980083:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422330496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.980115:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422330496:12345-0@lo:400:kworker.0 Request processed in 32us (6313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.980122:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789024088.980126:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024088.980136:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789024088.980171:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422330112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024088.980184:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422330752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024088.980205:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422330112:12345-0@lo:400:kworker.0 Request processed in 61us (6231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.980212:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789024088.980241:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789024088.980243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024088.980251:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422330624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024088.980290:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330752 00000100:00100000:2.0:1789024088.980295:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330752 00000100:00100000:1.0:1789024088.980301:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422330624:12345-0@lo:400:kworker.0 Request processed in 40us (6277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.980310:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789024088.980330:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789024088.980338:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422330752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024088.980352:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024088.980368:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422330112:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.981730:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329600 00000100:00100000:0.0:1789024088.981745:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329600 00000100:00100000:0.0:1789024088.981855:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422329344 00000100:00100000:0.0:1789024088.981860:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422329344 00000100:00100000:0.0:1789024088.981880:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789024088.981888:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422329600:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789024088.982110:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc07485c00 x1875927422330624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024088.982128:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422330624:0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.982183:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422329984:0@lo:400:kworker.0 00010000:00080000:1.0:1789024088.982198:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc07484e00 x1875927422330496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024088.982207:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422330496:0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.982254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789024088.982262:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422329344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.982495:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422329344:12345-0@lo:400:kworker.0 Request processed in 232us (8252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024088.982502:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00080000:1.0:1789024088.982547:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9f8a80 x1875927422328960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024088.982565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422328960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024088.983587:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422330752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3241us (3339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024088.983601:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789024088.983610:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422329600:12345-0@lo:400:kworker.0 Request processed in 1720us (9687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024088.983621:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789024088.983663:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024088.983734:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422329344:0@lo:400:kworker.0 00010000:00080000:0.0:1789024088.983757:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb021e3800 x1875927422329856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024088.983778:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422329856:0@lo:400:kworker.0 00010000:00080000:0.0:1789024088.983796:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc07484700 x1875927422330368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024088.983806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422330368:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.983822:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422329216:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.983836:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422329728:0@lo:400:kworker.0 00000100:00100000:0.0:1789024088.983849:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422330240:0@lo:400:kworker.0 00000100:00100000:1.0:1789024088.984051:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422329600:0@lo:400:kworker.0 00010000:00080000:3.0:1789024088.985322:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9f9180 x1875927422330752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024088.985366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422330752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024089.122401:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024089.122447:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024089.122469:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024089.122488:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024089.122518:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024089.122554:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315648 00000100:00100000:1.0:1789024089.122569:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315648 00000100:00100000:1.0:1789024089.122677:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315904 00000100:00100000:1.0:1789024089.122681:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315904 00000100:00100000:1.0:1789024089.122700:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315520 00000100:00100000:1.0:1789024089.122703:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315520 00000100:00100000:1.0:1789024089.122721:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315776 00000100:00100000:1.0:1789024089.122746:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315776 00000100:00100000:1.0:1789024089.122776:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 279 00000100:00100000:1.0:1789024089.122788:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402315648:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024089.122905:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402315648:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 120us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024089.122914:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 279 00000100:00100000:1.0:1789024089.122959:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 280 00000100:00100000:1.0:1789024089.122966:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315904:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024089.122994:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315904:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024089.123001:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 280 00000100:00100000:1.0:1789024089.123015:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 281 00000100:00100000:1.0:1789024089.123021:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402315520:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024089.123049:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402315520:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024089.123056:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 281 00000100:00100000:1.0:1789024089.123068:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 282 00000100:00100000:1.0:1789024089.123075:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315776:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024089.123100:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402315776:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024089.123106:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 282 00000100:00100000:0.0:1789024089.123919:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402315392 00000100:00100000:0.0:1789024089.123946:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402315392 00000100:00100000:0.0:1789024089.124011:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 380 00000100:00100000:0.0:1789024089.124022:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402315392:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024089.124085:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402315392:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 65us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024089.124092:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 380 00000100:00080000:0.0:1789024089.124179:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024089.124184:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789024089.933786:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789024090.001057:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:2.0:1789024090.001071:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cb038e8800/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:0.0:1789024090.001180:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb038e8800/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-OST0000 00000020:00000080:0.0:1789024090.001259:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb038ee000 for lustre-OST0000 00000100:00100000:1.0:1789024090.513178:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024090.513210:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422330880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024090.513307:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024090.513958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422330880 00000100:00100000:2.0:1789024090.513982:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422330880 00000100:00100000:2.0:1789024090.514052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789024090.514063:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422330880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024090.514110:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789024090.514209:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422330880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024090.514217:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789024090.514275:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422330880:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024090.960301:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024091.980550:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024092.561315:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422331008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024092.561421:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024092.561714:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331008 00000100:00100000:1.0:1789024092.561726:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331008 00000100:00100000:1.0:1789024092.561804:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789024092.562138:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422331008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024092.562218:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024092.562376:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422331008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 243us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024092.562384:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789024092.562461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422331008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789024093.006372:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789024093.181663:0:14062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:08:12 (1789024092) 00000100:00100000:2.0:1789024093.580816:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024093.580839:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422331264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024093.580951:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422331136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789024093.580962:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024093.581258:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331264 00000100:00100000:3.0:1789024093.581265:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331264 00000100:00100000:3.0:1789024093.581326:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789024093.581336:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422331264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024093.581364:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789024093.581424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024093.582070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024093.582248:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331136 00000100:00100000:0.0:1789024093.582264:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331136 00000100:00080000:2.0:1789024093.582291:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024093.582299:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789024093.582307:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422331136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024093.582323:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024093.582377:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422331136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024093.582385:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789024093.582652:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422331136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024093.582975:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422331264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1640us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024093.582983:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789024093.583196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422331264:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789024094.028497:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024094.092695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422331392:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.092782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024094.092867:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024094.092881:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422331648:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.092883:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422331776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024094.092977:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024094.092985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024094.093041:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331392 00000100:00100000:2.0:1789024094.093050:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331392 00000100:00100000:2.0:1789024094.093101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789024094.093110:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422331392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.093173:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422331392:12345-0@lo:400:kworker.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.093180:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789024094.093236:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422331392:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.093282:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422331520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024094.093306:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024094.096297:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422332288:0@lo:400:kworker.0 00000100:00100000:1.0:1789024094.101233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422331904:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103336:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422332160:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.103462:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422332672:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.103527:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789024094.103535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422332032:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.103599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422332544:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103666:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.103701:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422333056:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.103753:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.105156:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332160 00000100:00100000:3.0:1789024094.105174:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332160 00000100:00100000:3.0:1789024094.105285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024094.105298:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.105414:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331648 00000100:00100000:2.0:1789024094.105429:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331648 00000100:00100000:2.0:1789024094.105485:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332032 00000100:00100000:2.0:1789024094.105488:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332032 00000100:00100000:2.0:1789024094.105511:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789024094.105520:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422331648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.105692:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422331648:12345-0@lo:400:kworker.0 Request processed in 173us (12721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.105699:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789024094.105715:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789024094.105721:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422332032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.105748:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422332032:12345-0@lo:400:kworker.0 Request processed in 28us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.105753:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789024094.105774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024094.105803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422332800:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.105831:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024094.105855:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332288 00000100:00100000:2.0:1789024094.105858:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332288 00000100:00100000:2.0:1789024094.105879:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332800 00000100:00100000:2.0:1789024094.105881:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332800 00000100:00100000:3.0:1789024094.105937:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422332160:12345-0@lo:400:kworker.0 Request processed in 639us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.105947:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024094.105989:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332672 00000100:00100000:3.0:1789024094.105994:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332672 00000100:00100000:3.0:1789024094.106026:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332544 00000100:00100000:3.0:1789024094.106030:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332544 00000100:00100000:3.0:1789024094.106049:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422333056 00000100:00100000:3.0:1789024094.106052:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422333056 00000100:00100000:3.0:1789024094.106070:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789024094.106077:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422332672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106107:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789024094.106127:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422332288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024094.106127:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024094.106137:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422332672:12345-0@lo:400:kworker.0 Request processed in 57us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.106175:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789024094.106205:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422332288:12345-0@lo:400:kworker.0 Request processed in 87us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.106213:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789024094.106229:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789024094.106235:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106261:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422332800:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.106267:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789024094.106284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331904 00000100:00100000:2.0:1789024094.106297:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331904 00000100:00100000:2.0:1789024094.106616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789024094.106624:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422331904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106661:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422331904:12345-0@lo:400:kworker.0 Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.106667:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1789024094.106685:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024094.106691:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024094.106730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422332288:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106742:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422332800:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106809:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422332032:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106824:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422332160:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106835:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422332672:0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.106847:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422331648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.106902:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789024094.106917:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422332544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.106975:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422332544:12345-0@lo:400:kworker.0 Request processed in 63us (3309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.106981:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789024094.106998:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789024094.107003:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422333056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.107028:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422333056:12345-0@lo:400:kworker.0 Request processed in 26us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.107046:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789024094.107091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422332544:0@lo:400:kworker.0 00010000:00080000:3.0:1789024094.107107:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc107bb800 x1875927422333056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024094.107119:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422333056:0@lo:400:kworker.0 00000100:00100000:0.0:1789024094.107997:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331776 00000100:00100000:0.0:1789024094.108010:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331776 00000100:00100000:2.0:1789024094.108855:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422331520 00000100:00100000:2.0:1789024094.108869:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422331520 00000100:00100000:2.0:1789024094.108932:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789024094.108943:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422331776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024094.108979:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024094.109433:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789024094.109453:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422331520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789024094.109488:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024094.110077:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422331520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 630us (16768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024094.110086:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1789024094.110181:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf97b80 x1875927422331520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024094.110220:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422331520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024094.110281:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422331776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1335us (17303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.110293:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789024094.110318:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422331904:0@lo:400:kworker.0 00000100:00100000:0.0:1789024094.110334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422332416:0@lo:400:kworker.0 00000100:00100000:0.0:1789024094.111219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024094.111252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422332928:0@lo:400:kworker.0 00000100:00100000:0.0:1789024094.111280:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789024094.111333:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9edc00 x1875927422331776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024094.111352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422331776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024094.111430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332416 00000100:00100000:2.0:1789024094.111442:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332416 00000100:00080000:3.0:1789024094.111461:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024094.111533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422332928 00000100:00100000:2.0:1789024094.111538:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422332928 00000100:00080000:1.0:1789024094.114464:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024094.115469:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789024094.115515:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024094.115693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789024094.115713:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422332416:12345-0@lo:400:kworker.0 Request processed in 218us (4494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.115725:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422332928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024094.115726:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789024094.115839:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422332928:12345-0@lo:400:kworker.0 Request processed in 132us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.115849:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:1.0:1789024094.116572:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc07484000 x1875927422332416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024094.116593:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422332416:0@lo:400:kworker.0 00010000:00080000:1.0:1789024094.118049:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc107ba680 x1875927422332928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024094.118069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422332928:0@lo:400:kworker.0 00000100:00100000:1.0:1789024094.234601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024094.234650:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.234671:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316160 00000100:00100000:3.0:1789024094.234684:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316160 00000100:00100000:3.0:1789024094.234815:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316416 00000100:00100000:3.0:1789024094.234818:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316416 00000100:00080000:0.0:1789024094.234840:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024094.234887:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.234980:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 289 00000100:00100000:0.0:1789024094.234996:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 290 00000100:00100000:1.0:1789024094.235004:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.235005:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402316160:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024094.235007:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402316416:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024094.235062:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316288 00000100:00100000:0.0:1789024094.235066:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316288 00000100:00100000:0.0:1789024094.235101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 291 00000100:00100000:3.0:1789024094.235105:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402316160:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 107us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024094.235107:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402316288:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024094.235114:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 289 00000100:00100000:3.0:1789024094.235193:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316032 00000100:00100000:3.0:1789024094.235197:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316032 00000100:00100000:3.0:1789024094.235223:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 382 00000100:00100000:3.0:1789024094.235229:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2400:x1875927402316032:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024094.235772:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2400:x1875927402316032:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 538us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024094.235772:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402316288:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 660us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.235781:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 382 00000100:00100000:0.0:1789024094.235781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 291 00000100:00080000:0.0:1789024094.235803:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024094.235823:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402316416:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 819us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024094.235829:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 290 00000100:00100000:1.0:1789024094.236027:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024094.236172:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316544 00000100:00100000:2.0:1789024094.236177:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316544 00000100:00080000:0.0:1789024094.236234:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024094.236241:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 292 00000100:00100000:2.0:1789024094.236252:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402316544:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024094.236298:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2400:x1875927402316544:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024094.236305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 292 00000100:00100000:2.0:1789024094.580260:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.580383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316672 00000100:00100000:3.0:1789024094.580462:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316672 00000100:00100000:3.0:1789024094.580569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:3.0:1789024094.580581:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:11080:x1875927402316672:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024094.580603:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024094.580631:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af470 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580719:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580735:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024094.580784:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024094.580788:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024094.580831:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580879:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb3930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af470 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580916:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af470 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.580941:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024094.580944:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024094.580948:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488800, rc 0) 00000100:00100000:3.0:1789024094.581015:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:11080:x1875927402316672:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 437us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.581023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:0.0:1789024094.592180:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.592285:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316800 00000100:00100000:3.0:1789024094.592296:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316800 00000100:00100000:3.0:1789024094.592364:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:3.0:1789024094.592375:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:11081:x1875927402316800:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024094.592405:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024094.592428:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb393e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af477 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592501:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592516:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592526:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592541:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592547:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592568:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592631:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592638:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592646:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024094.592681:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024094.592685:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024094.592702:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592712:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592718:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.592724:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593546:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024094.593551:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593560:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593582:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024094.593585:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024094.593591:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593597:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593612:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593618:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593623:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593627:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024094.593629:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593635:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593641:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90cb0231b200) 00010000:00010000:3.0:1789024094.593644:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024094.593646:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593651:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb394c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593699:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb393e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af477 expref: 8 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593714:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af477 expref: 7 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024094.593722:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cb0231bd00) 00010000:00010000:3.0:1789024094.593724:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024094.594978:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5000, rc 0) 00000100:00100000:3.0:1789024094.595065:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11081:x1875927402316800:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 2688us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.595074:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:1.0:1789024094.604971:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024094.605192:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402316928 00000100:00100000:0.0:1789024094.605204:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402316928 00000100:00100000:0.0:1789024094.605280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:0.0:1789024094.605290:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11081:x1875927402316928:12345-192.168.202.18@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789024094.605382:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11081:x1875927402316928:12345-192.168.202.18@tcp:900:lhsmtool_posix.0 Request processed in 94us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024094.605417:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:1.0:1789024094.609728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024094.609838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317184 00000100:00100000:2.0:1789024094.609849:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317184 00000100:00100000:2.0:1789024094.609946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:2.0:1789024094.609957:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11081:x1875927402317184:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024094.609980:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024094.610003:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb395a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af47e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610091:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610109:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610142:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610256:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610265:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610272:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610782:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1c00/0xa736ef4b98cb396f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610793:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1c00/0xa736ef4b98cb396f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.610800:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1c00/0xa736ef4b98cb396f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024094.610811:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789024094.611109:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.611117:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.611124:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.611130:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024094.611142:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.611342:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.611354:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cb0231bd00) 00010000:00010000:2.0:1789024094.617520:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024094.617537:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617550:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617576:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617584:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617591:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617598:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024094.617602:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617609:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617625:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90cc3bce2200) 00010000:00010000:2.0:1789024094.617628:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024094.617649:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.617656:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3968 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.618371:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb395a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af47e expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.618390:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1c00/0xa736ef4b98cb396f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af47e expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024094.618409:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:2.0:1789024094.618412:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024094.618414:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1c00, rc 0) 00000100:00100000:2.0:1789024094.618494:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11081:x1875927402317184:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 8537us (8777us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789024094.618504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:3.0:1789024094.633227:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024094.633410:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317312 00000100:00100000:1.0:1789024094.633421:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317312 00000100:00100000:1.0:1789024094.633488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:1.0:1789024094.633499:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11081:x1875927402317312:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789024094.633613:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11081:x1875927402317312:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 116us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024094.633621:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:0.0:1789024094.642277:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024094.642387:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317440 00000100:00100000:3.0:1789024094.642406:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317440 00000100:00100000:3.0:1789024094.642459:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:3.0:1789024094.642468:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:11081:x1875927402317440:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789024094.649555:0:7824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7048us 00000100:00100000:3.0:1789024094.680635:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:11081:x1875927402317440:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 38153us (38352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024094.680653:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00010000:00010000:0.0:1789024095.053185:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024095.501806:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789024095.567424:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789024095.630240:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422333184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024095.630587:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024095.630730:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422333184 00000100:00100000:2.0:1789024095.630740:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422333184 00000100:00100000:2.0:1789024095.630798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789024095.630808:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422333184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024095.630849:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789024095.630915:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422333184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024095.630921:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789024095.630964:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422333184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024096.077010:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024096.654938:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.655444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317568 00000100:00100000:3.0:1789024096.655458:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317568 00000100:00100000:3.0:1789024096.655556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:3.0:1789024096.655573:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11125:x1875927402317568:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024096.655613:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024096.655635:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb397d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af485 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655699:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655713:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655723:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655737:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655744:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655750:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655794:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655801:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655807:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655813:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024096.655823:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655829:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655841:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024096.655844:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024096.655849:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655855:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655878:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655884:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655890:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655894:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024096.655897:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655903:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655910:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90cb0231b200) 00010000:00010000:3.0:1789024096.655913:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024096.655922:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655928:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb398b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655960:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb397d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af485 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.655970:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024096.655972:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024096.655975:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb397d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af485 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.656191:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789024096.656298:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11125:x1875927402317568:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 729us (1374us total) trans 0 rc 301/301 00000100:00100000:3.0:1789024096.656308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00080000:2.0:1789024096.656891:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024096.679590:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.679660:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317824 00000100:00100000:3.0:1789024096.679671:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317824 00000100:00100000:3.0:1789024096.679733:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:3.0:1789024096.679744:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11125:x1875927402317824:12345-192.168.202.18@tcp:36:lfs.0 00010000:00010000:3.0:1789024096.679797:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024096.679823:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb3937 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af470 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679841:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b500) 00010000:00010000:3.0:1789024096.679851:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024096.679937:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679950:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679960:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679972:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679990:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.679997:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680536:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680546:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680555:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024096.680569:0:13818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076317e4e reply state 00000000d13d199a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680580:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680587:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024096.680596:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024096.680600:0:13818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789024096.680605:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789024096.680613:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680620:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680628:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680634:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024096.680638:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680646:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680655:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024096.680658:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024096.680661:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680667:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb3992 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024096.680682:0:13818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076317e4e reply state 00000000d13d199a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680690:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.680706:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90cb0231ba00) 00010000:00010000:3.0:1789024096.680709:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024096.680711:0:13818:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789024096.680811:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+10:11125:x1875927402317824:12345-192.168.202.18@tcp:36:lfs.0 Request processed in 1067us (1229us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789024096.680819:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:1.0:1789024096.828932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.829030:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402317952 00000100:00100000:3.0:1789024096.829042:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402317952 00000100:00100000:3.0:1789024096.829115:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:3.0:1789024096.829126:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+10:11133:x1875927402317952:12345-192.168.202.18@tcp:101:lctl.0 00010000:00010000:3.0:1789024096.829194:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024096.829219:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb39a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af48c expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829303:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829317:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829330:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024096.829377:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024096.829382:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024096.829429:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829456:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb39a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af48c expref: 12 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829495:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af48c expref: 11 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.829505:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024096.829508:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024096.829513:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789024096.829576:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+11:11133:x1875927402317952:12345-192.168.202.18@tcp:101:lctl.0 Request processed in 451us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024096.829583:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:3.0:1789024096.875343:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024096.875456:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318080 00000100:00100000:1.0:1789024096.875469:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318080 00000100:00100000:1.0:1789024096.875542:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 48 00000100:00100000:1.0:1789024096.875553:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:11139:x1875927402318080:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024096.875581:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024096.875607:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb39b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af493 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875680:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875695:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875708:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875748:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875757:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875762:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875875:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875883:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875890:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024096.875924:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789024096.875927:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024096.875971:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875984:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875990:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.875997:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876014:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024096.876019:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876028:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876041:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:1.0:1789024096.876044:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024096.876049:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876056:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb39bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876070:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876076:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876081:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876085:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024096.876088:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876094:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876111:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90cb0231ba00) 00010000:00010000:1.0:1789024096.876114:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024096.876117:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876123:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb39c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876217:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb39b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af493 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876232:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af493 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024096.876240:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024096.876242:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789024096.876245:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55000, rc 0) 00000100:00100000:1.0:1789024096.876296:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+12:11139:x1875927402318080:12345-192.168.202.18@tcp:101:bash.0 Request processed in 745us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024096.876303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 48 00000100:00100000:0.0:1789024096.881122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024096.881305:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318336 00000100:00100000:2.0:1789024096.881319:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318336 00000100:00100000:2.0:1789024096.881384:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:2.0:1789024096.881395:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+12:11139:x1875927402318336:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024096.881419:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024096.881445:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb39d1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af49a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881575:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881593:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881604:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881662:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881671:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.881678:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789024096.882124:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789024096.882408:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882419:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882426:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882460:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882467:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882474:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882480:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024096.882485:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882491:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882501:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024096.882503:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024096.882507:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882512:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb39d8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024096.882536:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094b333e5 reply state 00000000438ae8e6 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882546:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882552:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:2.0:1789024096.882554:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024096.882556:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789024096.882587:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb39d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882601:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.882608:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:2.0:1789024096.882610:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024096.882612:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1800, rc 0) 00000100:00100000:2.0:1789024096.882818:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+15:11139:x1875927402318336:12345-192.168.202.18@tcp:101:bash.0 Request processed in 1422us (1704us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789024096.882827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:0.0:1789024096.887601:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.887703:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318464 00000100:00100000:3.0:1789024096.887714:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318464 00000100:00100000:3.0:1789024096.887894:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:3.0:1789024096.887904:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1875927402318464:12345-192.168.202.18@tcp:8:bash.0 00010000:00080000:3.0:1789024096.887943:0:8904:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:3.0:1789024096.887981:0:8904:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb39f4 00002000:00100000:3.0:1789024096.887996:0:8904:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 382f7d83-ada1-4b7e-b952-8068d9fee082/ffff90cc3544c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789024096.888022:0:8904:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789024096.888126:0:8904:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789024096.888348:0:8904:0:(import.c:65:import_set_state_nolock()) ffff90cc3544f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024096.888506:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402318464:12345-192.168.202.18@tcp:8:bash.0 Request processed in 601us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024096.888514:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:2.0:1789024096.894831:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.895003:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318592 00000100:00100000:3.0:1789024096.895031:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318592 00000100:00100000:3.0:1789024096.895122:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:3.0:1789024096.895130:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc35737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+6:0:x1875927402318592:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024096.895175:0:10202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024096.895199:0:10202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4a1 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024096.895233:0:10202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024096.895256:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789024096.895262:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024096.895272:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 7 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.895295:0:10202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 7 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024096.895319:0:10202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4a00, rc 0) 00000100:00100000:3.0:1789024096.895383:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc35737c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:0:x1875927402318592:12345-192.168.202.18@tcp:101:bash.0 Request processed in 253us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024096.895390:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00080000:2.0:1789024096.895712:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024096.900278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024096.900362:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318720 00000100:00100000:2.0:1789024096.900374:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318720 00000100:00100000:2.0:1789024096.900434:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:2.0:1789024096.900444:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11139:x1875927402318720:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024096.900479:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024096.900501:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4a8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.900533:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.900540:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024096.900544:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024096.900548:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.900585:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.900595:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024096.900606:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875927422333312:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024096.900696:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08a32240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024096.903723:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875927422333312:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024096.903771:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.903793:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0c00, rc 0) 00000100:00100000:2.0:1789024096.903905:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:11139:x1875927402318720:12345-192.168.202.18@tcp:101:bash.0 Request processed in 3461us (3638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024096.903914:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:0.0:1789024096.904578:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024096.904655:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402318848 00000100:00100000:2.0:1789024096.904664:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402318848 00010000:00010000:2.0:1789024096.904694:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024096.904731:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:2.0:1789024096.905472:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402318848:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024096.905490:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024096.905513:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.905527:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.905554:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb39fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a1 expref: 8 pid: 10202 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.905570:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024096.905574:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024096.905583:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.905592:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.905642:0:7924:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024096.905658:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7924:1875927422333440:192.168.202.18@tcp:105: 00000100:00100000:2.0:1789024096.905887:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08a32240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024096.909733:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7924:1875927422333440:192.168.202.18@tcp:105: 00010000:00010000:2.0:1789024096.909782:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024096.909853:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f195050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402318848:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 4391us (5277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024096.909879:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:1.0:1789024096.910820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024096.910946:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402319104 00000100:00100000:0.0:1789024096.910955:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402319104 00000100:00100000:0.0:1789024096.911054:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024096.911066:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+15:11139:x1875927402319104:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:0.0:1789024096.911474:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11139:x1875927402319104:12345-192.168.202.18@tcp:35:bash.0 Request processed in 410us (661us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789024096.911487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024096.977326:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024096.977490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402319360 00000100:00100000:2.0:1789024096.977500:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402319360 00000100:00100000:2.0:1789024096.977556:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:2.0:1789024096.977565:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11149:x1875927402319360:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024096.977592:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024096.977614:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4af expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024096.977698:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789024096.977782:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3a09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4af expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.977793:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:2.0:1789024096.977795:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024096.977812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4af expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024096.977823:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1a00, rc 0) 00000100:00100000:2.0:1789024096.977895:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11149:x1875927402319360:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 331us (582us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789024096.977903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:2.0:1789024096.979456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024096.979619:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402319616 00000100:00100000:3.0:1789024096.979626:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402319616 00000100:00100000:3.0:1789024096.979666:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:3.0:1789024096.979675:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11149:x1875927402319616:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024096.979844:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11149:x1875927402319616:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 170us (392us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789024096.980642:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:1.0:1789024097.040296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.040354:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402319744 00000100:00100000:3.0:1789024097.040365:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402319744 00000100:00100000:3.0:1789024097.040499:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:3.0:1789024097.040513:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11155:x1875927402319744:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024097.040545:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024097.040574:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4b6 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040650:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040668:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040688:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024097.040741:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789024097.040745:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024097.040768:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040796:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4b6 expref: 20 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040820:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4b6 expref: 19 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.040876:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024097.040881:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024097.040884:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4c00, rc 0) 00000100:00100000:3.0:1789024097.041008:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11155:x1875927402319744:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 498us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024097.041015:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:0.0:1789024097.044761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024097.044961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320000 00000100:00100000:2.0:1789024097.044972:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320000 00000100:00100000:2.0:1789024097.045109:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:2.0:1789024097.045121:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11155:x1875927402320000:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024097.045327:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024097.045353:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3a25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4bd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.045476:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3a2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.045491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.045505:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024097.045517:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789024097.045638:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3a25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4bd expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.045658:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3a2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4bd expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.045684:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:2.0:1789024097.045687:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024097.045691:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0400, rc 0) 00000100:00100000:2.0:1789024097.045760:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11155:x1875927402320000:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 641us (1010us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789024097.045767:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:2.0:1789024097.050488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.051247:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320256 00000100:00100000:3.0:1789024097.051258:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320256 00000100:00100000:3.0:1789024097.051329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:3.0:1789024097.051339:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11155:x1875927402320256:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024097.051364:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024097.051385:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.051502:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.051518:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.051530:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024097.051541:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789024097.051654:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4c4 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.051702:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4c4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.051711:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:3.0:1789024097.051714:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789024097.051718:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4600, rc 0) 00000100:00100000:3.0:1789024097.052375:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+23:11155:x1875927402320256:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1034us (1897us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789024097.052386:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:0.0:1789024097.052534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.053448:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320384 00000100:00100000:3.0:1789024097.053464:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320384 00000100:00100000:2.0:1789024097.056591:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024097.056621:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+23:2400:x1875927402320384:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024097.056646:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024097.056680:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3a2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4bd expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.056702:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:2.0:1789024097.056708:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024097.056791:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2400:x1875927402320384:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 188us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024097.056799:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:1.0:1789024097.058659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.058753:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320512 00000100:00100000:3.0:1789024097.058764:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320512 00000100:00100000:3.0:1789024097.058828:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:3.0:1789024097.058839:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402320512:12345-192.168.202.18@tcp:1:lfs.0 00010000:00010000:3.0:1789024097.058899:0:8904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.058919:0:8904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.058929:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789024097.058933:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024097.058937:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.058993:0:8904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.059007:0:8904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 7 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024097.059023:0:8904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8904:1875927422333568:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024097.059131:0:8904:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789024097.064978:0:8904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08783100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8904:1875927422333568:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024097.065015:0:8904:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.069643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.070025:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320640 00000100:00100000:0.0:1789024097.070112:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320640 00002000:00100000:0.0:1789024097.070191:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff90cc107bad80 x1875927402320640/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:268/0 lens 504/0 e 0 to 0 dl 1789024108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789024097.070285:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc107bad80 with x1875927402320640 ext(0->12) 00010000:00010000:0.0:1789024097.070297:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 8 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.070316:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 8 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024097.070325:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cc107bad80 00000100:00100000:0.0:1789024097.070411:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:0.0:1789024097.070422:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402320640:12345-192.168.202.18@tcp:4:lfs.0 00000001:00100000:2.0:1789024097.072536:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:0.0:1789024097.074393:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2403:x1875927402320640:12345-192.168.202.18@tcp:4:lfs.0 Request processed in 3962us (4755us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789024097.074407:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00002000:00100000:0.0:1789024097.074421:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff90cc107bad80 x1875927402320640/t4294967300(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:268/0 lens 504/448 e 0 to 0 dl 1789024108 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789024097.074432:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc107bad80 with x1875927402320640 ext(0->12) 00010000:00010000:0.0:1789024097.074456:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.074477:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024097.074486:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cc107bad80 00000100:00100000:3.0:1789024097.077055:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024097.077134:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402320768 00000100:00100000:2.0:1789024097.077376:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402320768 00010000:00010000:2.0:1789024097.077429:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024097.077524:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:2.0:1789024097.077548:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402320768:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024097.077563:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789024097.077580:0:6501:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789024097.077583:0:6501:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789024097 00002000:00010000:2.0:1789024097.077586:0:6501:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789024097 00002000:00010000:2.0:1789024097.077588:0:6501:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789024097 00002000:00010000:2.0:1789024097.077590:0:6501:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789024097.077596:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.077609:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.077632:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536117a7/0xa736ef4b98cb3a02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4a8 expref: 9 pid: 8432 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.077649:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024097.077653:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024097.077660:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.077669:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.077703:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024097.077776:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402320768:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 229us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024097.077794:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00010000:00010000:0.0:1789024097.078044:0:8904:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078061:0:8904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078082:0:8904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078090:0:8904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078098:0:8904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078105:0:8904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024097.078109:0:8904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078119:0:8904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078134:0:8904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.078142:0:8904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb3a4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.078255:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402320512:12345-192.168.202.18@tcp:1:lfs.0 Request processed in 19417us (19607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024097.078264:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:0.0:1789024097.081948:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.082439:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321024 00000100:00100000:1.0:1789024097.082452:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321024 00000100:00100000:0.0:1789024097.082620:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:0.0:1789024097.082633:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11155:x1875927402321024:12345-192.168.202.18@tcp:35:lfs.0 00000004:00010000:0.0:1789024097.082723:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4c4 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024097.082998:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1789024097.083379:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789024097.083709:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1789024097.083759:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.083781:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.083792:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.084586:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.084606:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 26 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.084639:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875927422333696:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024097.084776:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02052480 going to sleep for 11 seconds 00000100:00100000:3.0:1789024097.090066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.091229:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875927422333696:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024097.091259:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024097.091387:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321152 00000100:00100000:1.0:1789024097.091395:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321152 00010000:00010000:1.0:1789024097.091439:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 27 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024097.091501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:1.0:1789024097.091511:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+27:2403:x1875927402321152:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024097.091526:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024097.091533:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 27 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091544:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 27 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091573:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb39e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af49a expref: 27 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091591:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:1.0:1789024097.091597:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091607:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091614:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.091698:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024097.091785:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+26:2403:x1875927402321152:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 275us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024097.091793:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 54 00010000:00010000:0.0:1789024097.093669:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.093696:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024097.093980:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789024097.094387:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789024097.094490:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422333824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789024097.094564:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024097.094671:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc421cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024097.094724:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422333824 00000100:00100000:3.0:1789024097.094734:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422333824 00000100:00100000:3.0:1789024097.094847:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789024097.094878:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422333824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789024097.094980:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422333824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024097.094988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789024097.095242:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422333824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789024097.095428:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789024097.095487:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422333952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789024097.095524:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024097.095543:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024097.095693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422333952 00000100:00100000:0.0:1789024097.095700:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422333952 00000100:00100000:0.0:1789024097.095744:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789024097.095752:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422333952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789024097.095881:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1875927422333952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (356us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789024097.095888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789024097.095925:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422333952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789024097.095960:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789024097.096003:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096015:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096023:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096031:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024097.096189:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096200:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096224:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:0.0:1789024097.096227:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789024097.096233:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.096239:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3a56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789024097.096332:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789024097.096394:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789024097.096405:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415132258506ns, next at 416132256463ns, rc = 0 00000001:00080000:0.0:1789024097.096411:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789024097.096436:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351ff700) 00010000:00010000:0.0:1789024097.096439:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789024097.096445:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4c4 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.096558:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+29:11155:x1875927402321024:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 13927us (14622us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789024097.096567:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 8 00000020:00080000:0.0:1789024097.096571:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789024097.099310:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.099568:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321280 00000100:00100000:1.0:1789024097.099578:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321280 00000100:00100000:1.0:1789024097.099627:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:1.0:1789024097.099636:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+29:11155:x1875927402321280:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024097.099661:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024097.099684:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54800/0xa736ef4b98cb3a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4cb expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.099739:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54800/0xa736ef4b98cb3a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4cb expref: 30 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.099755:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54800/0xa736ef4b98cb3a5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4cb expref: 30 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.099775:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.099779:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024097.099782:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54800, rc 0) 00000100:00100000:1.0:1789024097.099842:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11155:x1875927402321280:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 207us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024097.099850:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 54 00010000:00010000:1.0:1789024097.101344:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789024097.102309:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024097.105262:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.105363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321536 00000100:00100000:3.0:1789024097.105377:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321536 00000100:00100000:3.0:1789024097.105438:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:3.0:1789024097.105448:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11155:x1875927402321536:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024097.105722:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+31:11155:x1875927402321536:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 273us (469us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789024097.105748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:0.0:1789024097.170812:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024097.171017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321792 00000100:00100000:2.0:1789024097.171029:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321792 00000100:00100000:2.0:1789024097.171208:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:2.0:1789024097.171217:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+31:11166:x1875927402321792:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024097.171241:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024097.171259:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024097.171344:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789024097.171429:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3a64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d2 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.171441:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:2.0:1789024097.171443:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024097.171447:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d2 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.171458:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0c00, rc 0) 00000100:00100000:2.0:1789024097.171505:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11166:x1875927402321792:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 291us (703us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789024097.171510:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:1.0:1789024097.174405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.174530:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402321920 00000100:00100000:3.0:1789024097.174540:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402321920 00000100:00100000:3.0:1789024097.174601:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:3.0:1789024097.174609:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11166:x1875927402321920:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:3.0:1789024097.174682:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174700:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174713:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174724:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174732:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174738:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174812:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174819:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174823:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024097.174900:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174923:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174931:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174937:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174940:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024097.174943:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174949:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174957:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024097.174959:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024097.174963:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174967:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3a72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174977:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174983:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.174995:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175000:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024097.175003:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175009:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175017:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:3.0:1789024097.175019:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024097.175022:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175038:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3a79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175047:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175051:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175055:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175058:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024097.175059:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175070:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175075:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:3.0:1789024097.175076:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024097.175078:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.175082:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3a80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024097.175172:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11166:x1875927402321920:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 537us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024097.175178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:0.0:1789024097.182450:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.182529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402322176 00000100:00100000:3.0:1789024097.182539:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402322176 00000100:00100000:3.0:1789024097.182659:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:3.0:1789024097.182667:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11166:x1875927402322176:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024097.184646:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+33:11166:x1875927402322176:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 1965us (2189us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789024097.184660:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:0.0:1789024097.227720:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.227828:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402322432 00000100:00100000:1.0:1789024097.227853:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402322432 00000100:00100000:1.0:1789024097.227933:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:1.0:1789024097.227944:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+33:11169:x1875927402322432:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024097.227969:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024097.227990:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3a87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4d9 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228081:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228098:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228109:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228120:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228128:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228134:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228556:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228566:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228573:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024097.228592:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789024097.228669:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228676:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228684:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228691:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024097.228697:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228705:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228718:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024097.228721:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024097.228726:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228731:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3a8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228744:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228750:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228765:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228770:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024097.228773:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228779:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228787:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:1.0:1789024097.228789:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024097.228792:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228797:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3a95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228851:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3a87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 36 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228881:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 35 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.228888:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.228891:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024097.228893:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55400, rc 0) 00000100:00100000:1.0:1789024097.229038:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11169:x1875927402322432:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1087us (1319us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789024097.229060:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:1.0:1789024097.246289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024097.249383:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402322560 00000100:00100000:2.0:1789024097.249400:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402322560 00000100:00100000:2.0:1789024097.249480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024097.249492:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11169:x1875927402322560:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:2.0:1789024097.249576:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249593:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249604:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249640:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249647:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249654:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.249661:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024097.249665:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.251041:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.251073:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024097.251076:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024097.251083:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024097.251092:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3aaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024097.251240:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11169:x1875927402322560:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 1746us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024097.251249:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024097.254223:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.254293:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402322816 00000100:00100000:0.0:1789024097.254302:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402322816 00000100:00100000:0.0:1789024097.254358:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:0.0:1789024097.254368:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11169:x1875927402322816:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:0.0:1789024097.254605:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+36:11169:x1875927402322816:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 237us (391us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789024097.254613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:0.0:1789024097.435422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.435503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323072 00000100:00100000:1.0:1789024097.435517:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323072 00000100:00100000:1.0:1789024097.435587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:1.0:1789024097.435599:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+36:11200:x1875927402323072:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:1.0:1789024097.435624:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024097.435645:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4e0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.435771:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ab8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.435785:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.435796:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024097.435807:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789024097.435953:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3ab1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e0 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.435983:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e0 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.435992:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.435994:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024097.436012:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54e00, rc 0) 00000100:00100000:1.0:1789024097.436090:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11200:x1875927402323072:12345-192.168.202.18@tcp:101:cat.0 Request processed in 493us (678us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789024097.436098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:1.0:1789024097.442210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.442252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.442306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323328 00000100:00100000:0.0:1789024097.442317:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323328 00000100:00100000:0.0:1789024097.442381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:0.0:1789024097.442391:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11200:x1875927402323328:12345-192.168.202.18@tcp:35:cat.0 00000100:00100000:0.0:1789024097.442639:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+39:11200:x1875927402323328:12345-192.168.202.18@tcp:35:cat.0 Request processed in 248us (438us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789024097.442647:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:3.0:1789024097.442765:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323456 00000100:00100000:3.0:1789024097.442772:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323456 00000100:00100000:3.0:1789024097.442818:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:3.0:1789024097.442826:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+39:2401:x1875927402323456:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024097.442837:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024097.442870:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ab8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e0 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.442912:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:3.0:1789024097.442917:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024097.442943:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+38:2401:x1875927402323456:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 119us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024097.442950:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:2.0:1789024097.495105:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.498532:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323712 00000100:00100000:0.0:1789024097.498566:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323712 00000100:00100000:0.0:1789024097.498721:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:0.0:1789024097.498734:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11206:x1875927402323712:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:0.0:1789024097.498763:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024097.498767:0:7824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789024097.498798:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4b6 expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.498819:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024097.498825:0:7824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024097.498839:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3ac6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4e7 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.498973:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.498988:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.498998:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.499048:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.499062:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 38 pid: 13818 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.499075:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334080:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024097.499240:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269180 going to sleep for 11 seconds 00000100:00100000:2.0:1789024097.512680:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.515051:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323840 00000100:00100000:1.0:1789024097.515067:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323840 00010000:00010000:1.0:1789024097.515122:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 39 pid: 13818 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024097.515200:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:1.0:1789024097.515211:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+39:2403:x1875927402323840:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024097.515226:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024097.515233:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 39 pid: 13818 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.515246:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 39 pid: 13818 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.515268:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.515274:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.515284:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.515291:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.515330:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024097.515407:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+39:2403:x1875927402323840:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 198us (2737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024097.515415:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00010000:00010000:0.0:1789024097.520328:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3a9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4d9 expref: 38 pid: 13818 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.520372:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334080:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024097.520401:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.520412:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.520418:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024097.520441:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789024097.520638:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3ac6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 39 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.520656:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 38 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.520667:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024097.520670:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789024097.520675:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f200, rc 0) 00000100:00100000:0.0:1789024097.520766:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11206:x1875927402323712:12345-192.168.202.18@tcp:101:dd.0 Request processed in 22034us (25669us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789024097.520775:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:2.0:1789024097.526645:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.526734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402323968 00000100:00100000:0.0:1789024097.526758:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402323968 00000100:00100000:0.0:1789024097.526831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:0.0:1789024097.526842:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11206:x1875927402323968:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:0.0:1789024097.526915:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024097.526941:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3adb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4ee expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.526983:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.527000:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.527013:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.527451:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3adb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.527475:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.527484:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024097.527487:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789024097.527492:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e800, rc 0) 00000100:00100000:0.0:1789024097.527577:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+39:11206:x1875927402323968:12345-192.168.202.18@tcp:101:dd.0 Request processed in 736us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024097.527584:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:2.0:1789024097.534802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.534962:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402324224 00000100:00100000:3.0:1789024097.534972:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402324224 00000100:00100000:3.0:1789024097.535045:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:3.0:1789024097.535056:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+39:11206:x1875927402324224:12345-192.168.202.18@tcp:36:dd.0 00010000:00010000:3.0:1789024097.535711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.535734:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.535746:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789024097.535794:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789024097.535823:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000386a1aae reply state 00000000c8176f89 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.535836:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.535844:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:3.0:1789024097.535847:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024097.535852:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024097.536899:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+42:11206:x1875927402324224:12345-192.168.202.18@tcp:36:dd.0 Request processed in 1835us (2103us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789024097.538799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 62 00000020:00080000:3.0:1789024097.538814:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1789024097.549095:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789024097.612979:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789024097.677803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422334208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024097.677917:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024097.679604:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422334208 00000100:00100000:1.0:1789024097.679618:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422334208 00000100:00100000:1.0:1789024097.679696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789024097.679707:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422334208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024097.679753:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024097.679845:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422334208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024097.679865:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789024097.680672:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422334208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024097.786721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.786846:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402324352 00000100:00100000:0.0:1789024097.787267:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402324352 00000100:00100000:0.0:1789024097.787495:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:0.0:1789024097.787509:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+42:11220:x1875927402324352:12345-192.168.202.18@tcp:101:stat.0 00010000:00010000:0.0:1789024097.787547:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024097.787573:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3af0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4f5 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787643:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787661:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787674:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787686:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787694:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787701:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787787:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787798:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 43 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.787825:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.789839:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 43 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.790511:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 43 pid: 7824 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024097.790534:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334336:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024097.790788:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269180 going to sleep for 11 seconds 00000100:00100000:0.0:1789024097.808189:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334336:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024097.808246:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024097.809072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024097.809533:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402324608 00000100:00100000:0.0:1789024097.809545:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402324608 00000100:00100000:0.0:1789024097.809617:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:0.0:1789024097.809627:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+44:6171:x1875927402324608:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789024097.810582:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+45:6171:x1875927402324608:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 952us (1511us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789024097.810591:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:2.0:1789024097.822336:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024097.822690:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402324736 00000100:00100000:3.0:1789024097.822702:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402324736 00010000:00010000:3.0:1789024097.822747:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 45 pid: 7824 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024097.822827:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:3.0:1789024097.822843:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+45:2403:x1875927402324736:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024097.822868:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024097.822876:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 45 pid: 7824 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.822891:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 45 pid: 7824 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.822915:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3acd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4e7 expref: 45 pid: 7824 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.822934:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:3.0:1789024097.822945:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.822956:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.822983:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024097.823008:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024097.823035:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823043:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024097.823105:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000100:00100000:3.0:1789024097.823108:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+44:2403:x1875927402324736:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 271us (781us total) trans 0 rc 0/0 00000004:00200000:0.0:1789024097.823109:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1789024097.823115:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 56 00000004:00010000:0.0:1789024097.823178:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823192:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823201:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823208:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823215:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823222:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024097.823227:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823235:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823244:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024097.823247:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024097.823251:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823257:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3af7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823281:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823288:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823294:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823299:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024097.823302:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823309:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823318:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:0.0:1789024097.823321:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024097.823324:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823330:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3afe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823365:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3af0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4f5 expref: 44 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823380:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4f5 expref: 43 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024097.823399:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024097.823402:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024097.823404:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024097.823434:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+43:11220:x1875927402324352:12345-192.168.202.18@tcp:101:stat.0 Request processed in 35929us (36728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024097.823442:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:3.0:1789024097.879281:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024097.880646:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402324992 00000100:00100000:1.0:1789024097.880666:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402324992 00000100:00100000:1.0:1789024097.880777:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:1.0:1789024097.880788:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+43:11226:x1875927402324992:12345-192.168.202.18@tcp:36:truncate.0 00010000:00010000:1.0:1789024097.880872:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024097.880906:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4f5 expref: 43 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.884319:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.884332:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024097.884547:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.884566:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.884608:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024097.884656:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789024097.884681:0:13818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251e9343 reply state 000000005838b7f4 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.884870:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024097.884878:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024097.884881:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024097.884885:0:13818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024097.885118:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+45:11226:x1875927402324992:12345-192.168.202.18@tcp:36:truncate.0 Request processed in 4326us (5846us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789024097.885128:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00000020:00080000:1.0:1789024097.885135:0:13818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789024098.064062:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.064271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402325120 00000100:00100000:1.0:1789024098.064287:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402325120 00000100:00100000:1.0:1789024098.064389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:1.0:1789024098.064403:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+45:11240:x1875927402325120:12345-192.168.202.18@tcp:101:stat.0 00010000:00010000:1.0:1789024098.064434:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024098.064460:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3b13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af4fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064552:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064570:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064602:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064615:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064623:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064629:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064728:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064738:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064745:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024098.064789:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789024098.064794:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024098.064817:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064830:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064838:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064866:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064873:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064879:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024098.064884:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064892:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064903:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024098.064906:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024098.064912:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064918:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3b1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064946:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064953:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064959:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064964:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024098.064974:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064981:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.064989:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:1.0:1789024098.064992:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024098.064995:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.065001:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.065030:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3b13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.065044:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.065051:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024098.065053:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024098.065055:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54c00, rc 0) 00000100:00100000:1.0:1789024098.065125:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+46:11240:x1875927402325120:12345-192.168.202.18@tcp:101:stat.0 Request processed in 726us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024098.065133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00080000:2.0:1789024098.066103:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789024098.126020:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024098.161181:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024098.161617:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402325376 00000100:00100000:0.0:1789024098.161629:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402325376 00000100:00100000:2.0:1789024098.161797:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:2.0:1789024098.161811:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+46:11250:x1875927402325376:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024098.161832:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024098.161863:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af503 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.161983:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789024098.162099:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3b2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af503 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.162134:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:2.0:1789024098.162137:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024098.162143:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af503 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.162197:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1a00, rc 0) 00000100:00100000:2.0:1789024098.162266:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+47:11250:x1875927402325376:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 459us (1125us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789024098.162275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:3.0:1789024098.165671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.165789:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402325632 00000100:00100000:1.0:1789024098.165800:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402325632 00000100:00100000:1.0:1789024098.165883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:1.0:1789024098.165896:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+47:11250:x1875927402325632:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:1.0:1789024098.166212:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+48:11250:x1875927402325632:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 310us (548us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789024098.166220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:3.0:1789024098.222392:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.222547:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402325888 00000100:00100000:1.0:1789024098.222557:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402325888 00000100:00100000:1.0:1789024098.222627:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:1.0:1789024098.222637:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+48:11256:x1875927402325888:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024098.222666:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024098.222688:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3b3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af50a expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.222830:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.222847:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.222879:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.222917:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.222931:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 49 pid: 6517 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024098.222945:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422334464:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024098.223057:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269180 going to sleep for 11 seconds 00000100:00100000:1.0:1789024098.226478:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422334464:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024098.226518:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024098.228052:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.228210:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402326016 00000100:00100000:1.0:1789024098.228224:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402326016 00010000:00010000:1.0:1789024098.228272:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 50 pid: 6517 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024098.228315:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:1.0:1789024098.228326:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+50:2402:x1875927402326016:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024098.228347:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024098.228354:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 50 pid: 6517 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228368:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 50 pid: 6517 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228396:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4fc expref: 50 pid: 6517 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228418:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024098.228423:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228437:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228472:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.228517:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024098.228569:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f194c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+49:2402:x1875927402326016:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 244us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024098.228577:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 57 00010000:00010000:2.0:1789024098.228611:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.228621:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.228641:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789024098.228798:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3b3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 50 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.228815:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 49 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.228823:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.228826:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789024098.228828:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55200, rc 0) 00000100:00100000:2.0:1789024098.228896:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+49:11256:x1875927402325888:12345-192.168.202.18@tcp:101:bash.0 Request processed in 6260us (6515us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789024098.228914:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:3.0:1789024098.235094:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024098.235229:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402326272 00000100:00100000:0.0:1789024098.235241:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402326272 00000100:00100000:0.0:1789024098.235306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:0.0:1789024098.235316:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+49:11256:x1875927402326272:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:0.0:1789024098.235555:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.235573:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.235586:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024098.235626:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1789024098.235647:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b066ccbb reply state 00000000911149a8 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.235661:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.235669:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024098.235688:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789024098.235692:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789024098.235802:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+52:11256:x1875927402326272:12345-192.168.202.18@tcp:36:bash.0 Request processed in 485us (718us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1789024098.235809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00000020:00080000:0.0:1789024098.235814:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789024098.242293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.242466:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402326400 00000100:00100000:1.0:1789024098.242482:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402326400 00000100:00100000:1.0:1789024098.242565:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:1.0:1789024098.242578:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+52:11256:x1875927402326400:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024098.242604:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024098.242628:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af511 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.242739:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.242756:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 53 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.242765:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.242805:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 53 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.242819:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 53 pid: 13818 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024098.242871:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334592:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024098.242977:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02052480 going to sleep for 11 seconds 00000100:00100000:1.0:1789024098.246349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.246509:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402326528 00000100:00100000:2.0:1789024098.246520:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402326528 00010000:00010000:2.0:1789024098.246563:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 54 pid: 13818 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024098.246606:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024098.246616:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+54:2402:x1875927402326528:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024098.246632:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024098.246639:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 54 pid: 13818 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.246651:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 54 pid: 13818 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.246676:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.246682:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.246693:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.246701:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.246724:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024098.246785:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+54:2402:x1875927402326528:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 170us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.246810:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 58 00010000:00010000:0.0:1789024098.247632:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3b44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af50a expref: 53 pid: 13818 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024098.247655:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422334592:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024098.247680:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.247691:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.247697:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024098.247761:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789024098.247767:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024098.247794:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.247829:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3b59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af511 expref: 53 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.247843:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af511 expref: 52 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.248020:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024098.248023:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024098.248026:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55800, rc 0) 00000100:00100000:0.0:1789024098.248130:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+52:11256:x1875927402326400:12345-192.168.202.18@tcp:101:bash.0 Request processed in 5553us (5847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024098.248137:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:1.0:1789024098.252952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024098.253036:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402326784 00000100:00100000:3.0:1789024098.253048:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402326784 00000100:00100000:3.0:1789024098.253111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:3.0:1789024098.253123:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+52:11256:x1875927402326784:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:3.0:1789024098.253445:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11256:x1875927402326784:12345-192.168.202.18@tcp:35:bash.0 Request processed in 323us (502us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789024098.253452:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:3.0:1789024098.340122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.340405:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327040 00000100:00100000:2.0:1789024098.340417:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327040 00000100:00100000:2.0:1789024098.340494:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:2.0:1789024098.340506:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11266:x1875927402327040:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024098.340533:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024098.340555:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3b67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af518 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.340651:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789024098.340761:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3b67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af518 expref: 55 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.340775:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:2.0:1789024098.340778:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024098.340783:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3b67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af518 expref: 55 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.340797:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1800, rc 0) 00000100:00100000:2.0:1789024098.341013:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11266:x1875927402327040:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 509us (903us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789024098.341021:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:2.0:1789024098.349088:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024098.349513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327168 00000100:00100000:3.0:1789024098.349525:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327168 00000100:00100000:3.0:1789024098.349590:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:3.0:1789024098.349603:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11266:x1875927402327168:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:3.0:1789024098.349713:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.349732:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.349745:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.349756:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.349762:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.349768:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.350312:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.350326:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024098.350335:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024098.350553:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350570:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350588:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350596:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350602:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.350606:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350614:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350627:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024098.350630:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024098.350635:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350640:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3b75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350654:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350659:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350664:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350668:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.350677:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350683:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350691:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:2.0:1789024098.350694:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024098.350697:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350702:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3b7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350712:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350718:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350724:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350729:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.350732:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350738:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350745:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.350747:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024098.350755:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.350761:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3b83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024098.351359:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11266:x1875927402327168:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 1752us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.351371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:1.0:1789024098.354414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024098.354605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327424 00000100:00100000:3.0:1789024098.354615:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327424 00000100:00100000:3.0:1789024098.354686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:3.0:1789024098.354697:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11266:x1875927402327424:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024098.355187:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+55:11266:x1875927402327424:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 491us (787us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789024098.356039:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:3.0:1789024098.388961:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024098.389189:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327680 00000100:00100000:0.0:1789024098.389204:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327680 00000100:00100000:0.0:1789024098.389312:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:0.0:1789024098.389325:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+55:11269:x1875927402327680:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024098.389361:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024098.389387:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3b8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af51f expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389508:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389524:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389536:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389551:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389557:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389580:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389716:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389726:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.389734:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024098.389747:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789024098.389848:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390500:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390507:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390514:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024098.390519:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390527:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390543:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024098.390546:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024098.390563:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390570:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3b91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390587:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390593:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390598:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390603:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024098.390605:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390610:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390618:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:0.0:1789024098.390621:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024098.390624:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390628:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3b98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390685:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3b8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af51f expref: 58 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390712:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af51f expref: 57 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024098.390720:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:0.0:1789024098.390723:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024098.390726:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024098.390808:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+57:11269:x1875927402327680:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1484us (1858us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789024098.390831:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:2.0:1789024098.393992:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.394352:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327808 00000100:00100000:1.0:1789024098.394365:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327808 00000100:00100000:1.0:1789024098.394450:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:1.0:1789024098.394462:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+57:2400:x1875927402327808:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024098.394481:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024098.394510:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3b9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af51f expref: 57 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.394531:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024098.394537:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024098.394613:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+56:2400:x1875927402327808:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 153us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024098.394620:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:1.0:1789024098.396231:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.396362:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402327936 00000100:00100000:2.0:1789024098.396372:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402327936 00000100:00100000:2.0:1789024098.396431:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 73 00000100:00100000:2.0:1789024098.396438:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+56:11269:x1875927402327936:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:2.0:1789024098.396512:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396533:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396546:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396583:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396590:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396596:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396618:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.396623:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396631:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396644:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.396647:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024098.396651:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.396658:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024098.396743:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+56:11269:x1875927402327936:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 304us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.396750:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 73 00000100:00100000:0.0:1789024098.407730:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024098.407841:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402328192 00000100:00100000:3.0:1789024098.407871:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402328192 00000100:00100000:3.0:1789024098.407966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:3.0:1789024098.407980:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+56:11269:x1875927402328192:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024098.408406:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+57:11269:x1875927402328192:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 427us (689us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789024098.408416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:3.0:1789024098.612110:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.612236:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402328448 00000100:00100000:2.0:1789024098.612253:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402328448 00000100:00100000:2.0:1789024098.612312:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 74 00000100:00100000:2.0:1789024098.612320:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+57:11287:x1875927402328448:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:2.0:1789024098.612343:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024098.612361:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af526 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.612520:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.612540:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.612550:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.612562:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789024098.614974:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af526 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.615080:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af526 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.615091:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.615094:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789024098.615098:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db1800, rc 0) 00000100:00100000:2.0:1789024098.615222:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11287:x1875927402328448:12345-192.168.202.18@tcp:101:cat.0 Request processed in 2900us (3128us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789024098.615231:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 74 00000100:00100000:0.0:1789024098.642334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.642464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402328576 00000100:00100000:2.0:1789024098.642477:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402328576 00000100:00100000:2.0:1789024098.642738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 75 00000100:00100000:2.0:1789024098.642749:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11288:x1875927402328576:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024098.642771:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024098.642789:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af52d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.642997:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.643011:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.643020:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.643057:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789024098.643059:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024098.643074:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.643093:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af52d expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.643105:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af52d expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.643111:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024098.643113:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024098.643116:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc15db0c00, rc 0) 00000100:00100000:2.0:1789024098.643233:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11288:x1875927402328576:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 487us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.643238:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 75 00000100:00100000:3.0:1789024098.647276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.647364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402328960 00000100:00100000:1.0:1789024098.647372:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402328960 00000100:00100000:1.0:1789024098.647419:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:1.0:1789024098.647427:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11288:x1875927402328960:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:1.0:1789024098.647740:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11288:x1875927402328960:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 312us (472us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789024098.647761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:3.0:1789024098.649989:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.650128:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329088 00000100:00100000:2.0:1789024098.650138:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329088 00000100:00100000:2.0:1789024098.650275:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:2.0:1789024098.650283:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11288:x1875927402329088:12345-192.168.202.18@tcp:103:lfs.0 00010000:00010000:2.0:1789024098.650296:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789024098.650317:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3b60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af511 expref: 61 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.650333:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af526 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.650341:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54800/0xa736ef4b98cb3a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4cb expref: 59 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.650347:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.650351:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024098.650396:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11288:x1875927402329088:12345-192.168.202.18@tcp:103:lfs.0 Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.650401:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024098.653232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024098.653330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329216 00000100:00100000:1.0:1789024098.653339:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329216 00000100:00100000:1.0:1789024098.653390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:1.0:1789024098.653397:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11288:x1875927402329216:12345-192.168.202.18@tcp:58:lfs.0 00010000:00010000:1.0:1789024098.653533:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.653546:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024098.653554:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024098.653777:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789024098.653919:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789024098.654014:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789024098.654095:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11288:x1875927402329216:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 697us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024098.654100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:0.0:1789024098.677255:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024098.677758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329344 00000100:00100000:2.0:1789024098.677768:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329344 00000100:00100000:2.0:1789024098.677823:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 77 00000100:00100000:2.0:1789024098.677831:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11290:x1875927402329344:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024098.678067:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024098.678090:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af534 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678192:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678290:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678299:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678310:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678315:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678319:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678383:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678388:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678392:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024098.678432:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789024098.678435:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024098.678450:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678458:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678471:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678475:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678480:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678483:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.678486:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678492:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678500:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024098.678502:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024098.678505:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678508:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3be5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678517:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678522:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678528:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678538:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024098.678541:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678546:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678553:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:2.0:1789024098.678555:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024098.678558:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678562:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3bec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678704:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3bde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678720:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024098.678727:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024098.678729:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024098.678731:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030800, rc 0) 00000100:00100000:2.0:1789024098.678804:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11290:x1875927402329344:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 972us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.678812:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 77 00000100:00100000:1.0:1789024098.700942:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024098.700969:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422334720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024098.701036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024098.701321:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422334720 00000100:00100000:2.0:1789024098.701341:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422334720 00000100:00100000:3.0:1789024098.701542:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422334848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024098.701575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789024098.701610:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024098.711251:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422334848 00000100:00100000:2.0:1789024098.711272:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422334848 00000100:00100000:1.0:1789024098.711427:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789024098.711442:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422334720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024098.711486:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024098.711595:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422334720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (10558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024098.711616:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789024098.711712:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422334720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024098.711869:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789024098.711878:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422334848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024098.711891:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024098.711927:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422334848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (10352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024098.711933:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789024098.712070:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422334848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789024098.717733:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789024099.152343:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024099.212711:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024099.212732:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422334976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024099.212799:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024099.212875:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422334976 00000100:00100000:2.0:1789024099.212883:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422334976 00000100:00100000:2.0:1789024099.213123:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789024099.213132:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422334976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024099.213192:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789024099.213233:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422334976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.213240:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789024099.213262:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422335104:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213298:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213323:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422335488:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213328:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422335616:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213351:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422336128:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213366:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422336000:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213389:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422335232:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213402:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3d493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422336512:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213428:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422335744:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213434:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789024099.213439:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422335360:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213447:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213458:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213460:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422336256:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213471:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422335872:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213484:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213511:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335616 00000100:00100000:1.0:1789024099.213514:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335616 00000100:00100000:0.0:1789024099.213517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422336384:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213536:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.213539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335360 00000100:00100000:1.0:1789024099.213542:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335360 00000100:00100000:1.0:1789024099.213554:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789024099.213556:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336000 00000100:00100000:0.0:1789024099.213558:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336000 00000100:00100000:1.0:1789024099.213560:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213579:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336512 00000100:00100000:0.0:1789024099.213582:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336512 00000100:00100000:1.0:1789024099.213593:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422335616:12345-0@lo:400:kworker.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.213599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789024099.213601:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789024099.213606:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422336000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789024099.213640:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422336000:12345-0@lo:400:kworker.0 Request processed in 33us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.213645:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213645:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789024099.213659:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789024099.213664:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422336512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213680:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422335360:12345-0@lo:400:kworker.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.213684:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422336512:12345-0@lo:400:kworker.0 Request processed in 21us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.213686:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789024099.213689:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789024099.213703:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024099.213718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422335360:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213727:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422336000:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213728:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34603b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422335616:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.213735:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3d493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422336512:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.213749:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335488 00000100:00100000:1.0:1789024099.213766:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335488 00000100:00100000:1.0:1789024099.213784:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335232 00000100:00100000:1.0:1789024099.213787:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335232 00000100:00100000:1.0:1789024099.213796:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335744 00000100:00100000:1.0:1789024099.213798:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335744 00000100:00100000:1.0:1789024099.213809:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336256 00000100:00100000:1.0:1789024099.213811:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336256 00000100:00100000:1.0:1789024099.213821:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335872 00000100:00100000:1.0:1789024099.213823:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335872 00000100:00100000:1.0:1789024099.213834:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336384 00000100:00100000:1.0:1789024099.213836:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336384 00000100:00100000:0.0:1789024099.213857:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789024099.213894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422335104 00000100:00100000:2.0:1789024099.213908:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422335104 00000100:00100000:2.0:1789024099.213934:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000004:00080000:3.0:1789024099.213939:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417249791635ns, next at 418249789478ns, rc = 0 00000100:00100000:2.0:1789024099.213940:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422335104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789024099.213959:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024099.213962:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024099.213965:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024099.213990:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024099.214016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024099.214059:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422335104:12345-0@lo:400:kworker.0 Request processed in 118us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.214061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422335104:0@lo:400:kworker.0 00000100:00100000:2.0:1789024099.214071:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789024099.214120:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.214196:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422335488:12345-0@lo:400:kworker.0 Request processed in 331us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.214314:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422335488:0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.214883:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789024099.214893:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.214943:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422335232:12345-0@lo:400:kworker.0 Request processed in 53us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.214950:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789024099.214968:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789024099.214975:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422335744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.215003:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422335744:12345-0@lo:400:kworker.0 Request processed in 29us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.215008:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789024099.215021:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789024099.215034:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422336256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.215061:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422336256:12345-0@lo:400:kworker.0 Request processed in 29us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.215067:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789024099.215081:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789024099.215087:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422335872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.215118:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422335872:12345-0@lo:400:kworker.0 Request processed in 31us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.215124:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789024099.215138:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789024099.215164:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422336384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.215193:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422336384:12345-0@lo:400:kworker.0 Request processed in 50us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.215199:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789024099.215228:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336128 00000100:00100000:1.0:1789024099.215234:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336128 00000100:00100000:1.0:1789024099.215262:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789024099.215268:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422336128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024099.215301:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422336128:12345-0@lo:400:kworker.0 Request processed in 33us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.215306:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789024099.216042:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336640 00000100:00100000:1.0:1789024099.216049:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336640 00000100:00100000:1.0:1789024099.216081:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789024099.216089:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422336640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024099.216106:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789024099.216172:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422336640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.216179:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789024099.217652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422335232:0@lo:400:kworker.0 00000100:00100000:2.0:1789024099.217669:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422335744:0@lo:400:kworker.0 00000100:00100000:2.0:1789024099.217681:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422336256:0@lo:400:kworker.0 00010000:00080000:2.0:1789024099.217735:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3be9f100 x1875927422335872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024099.217745:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422335872:0@lo:400:kworker.0 00010000:00080000:2.0:1789024099.217756:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f974700 x1875927422336384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024099.217765:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422336384:0@lo:400:kworker.0 00000100:00100000:0.0:1789024099.220236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789024099.220372:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422334976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024099.220734:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422336640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024099.220762:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422336128:0@lo:400:kworker.0 00000100:00100000:2.0:1789024099.350947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.351000:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.351022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329472 00000100:00100000:0.0:1789024099.351034:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329472 00000100:00100000:2.0:1789024099.351038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.351068:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.351116:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.351121:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 384 00000100:00100000:0.0:1789024099.351138:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402329472:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024099.351179:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329600 00000100:00100000:2.0:1789024099.351185:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329600 00000100:00100000:2.0:1789024099.351235:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329984 00000100:00100000:2.0:1789024099.351239:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329984 00000100:00100000:0.0:1789024099.351262:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402329472:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 128us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.351266:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329856 00000100:00100000:2.0:1789024099.351270:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329856 00000100:00100000:0.0:1789024099.351274:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 384 00000100:00100000:2.0:1789024099.351292:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 299 00000100:00100000:2.0:1789024099.351302:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402329600:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024099.351340:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402329600:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.351355:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 299 00000100:00100000:2.0:1789024099.351372:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 300 00000100:00100000:2.0:1789024099.351380:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402329984:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024099.351452:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402329728 00000100:00100000:1.0:1789024099.351457:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402329728 00000100:00100000:1.0:1789024099.351503:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 87 00000100:00100000:1.0:1789024099.351511:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402329728:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024099.351565:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402329984:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 185us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.351572:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 300 00000100:00100000:2.0:1789024099.351585:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 301 00000100:00100000:2.0:1789024099.351593:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402329856:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024099.351621:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402329856:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.351626:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 301 00000100:00080000:2.0:1789024099.351653:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024099.351657:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024099.351660:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024099.357434:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402329728:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 5910us (6419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.357452:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 87 00000040:00080000:2.0:1789024099.512731:0:14209:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789024099.512740:0:14209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789024099.517112:0:14209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789024099.517128:0:14209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789024099.604936:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024099.604945:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024099.604977:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789024099.604987:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789024099.605134:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03874000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422336768:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024099.605270:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789024099.620035:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.620106:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402330112 00000100:00100000:3.0:1789024099.620118:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402330112 00000100:00100000:3.0:1789024099.620219:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 78 00000100:00100000:3.0:1789024099.620232:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11302:x1875927402330112:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789024099.620271:0:7824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789024099.620397:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11302:x1875927402330112:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 168us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.620405:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 78 00000100:00100000:1.0:1789024099.622646:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03874000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422336768:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024099.624023:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.624092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402330240 00000100:00100000:2.0:1789024099.624104:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402330240 00000100:00100000:2.0:1789024099.624199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 79 00000100:00100000:2.0:1789024099.624209:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11302:x1875927402330240:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789024099.624280:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624311:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624323:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624338:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624344:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624350:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624376:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624385:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624391:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024099.624433:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789024099.624449:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024099.624470:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624481:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624498:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624505:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624511:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.624515:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624523:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624538:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:2.0:1789024099.624543:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.624550:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624556:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0400/0xa736ef4b98cb3bfa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624570:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624575:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624581:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624587:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.624597:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624605:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624613:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff90cc351ffe00) 00010000:00010000:2.0:1789024099.624615:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.624618:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624624:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1a00/0xa736ef4b98cb3c01 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624649:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624656:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624662:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624668:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.624671:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624677:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624688:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.624691:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.624701:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.624707:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1800/0xa736ef4b98cb3c08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.624786:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11302:x1875927402330240:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 Request processed in 578us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.624795:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 79 00000004:00080000:3.0:1789024099.628629:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789024099.628677:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000100:00100000:2.0:1789024099.628741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000004:00080000:3.0:1789024099.628752:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789024099.628763:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cc4154ca80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789024099.628768:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cb01082800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cc4154c0c0 00000020:00080000:3.0:1789024099.628771:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cb01082d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cc18f31a00 00010000:00010000:2.0:1789024099.629299:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629312:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629320:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629325:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629330:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629337:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629352:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90cb0231ba00) 00010000:00010000:2.0:1789024099.629355:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629359:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629365:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3999 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629409:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629414:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629420:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629425:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629427:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629433:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629452:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024099.629456:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629459:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629465:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb39a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629483:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629489:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629494:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629510:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629512:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629518:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629527:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ff600) 00010000:00010000:2.0:1789024099.629529:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629532:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629538:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0a00/0xa736ef4b98cb39df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629560:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629566:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629571:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629576:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629579:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629585:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629609:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.629612:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629619:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629626:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3ae9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629637:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629643:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629649:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629654:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629657:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629662:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629669:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.629671:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629673:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629679:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3b0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629701:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629707:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629713:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629718:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.629725:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629734:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629743:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.629748:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.629751:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.629758:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3b52 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.629784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402330496 00000100:00100000:2.0:1789024099.629792:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402330496 00000100:00100000:2.0:1789024099.629856:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 80 00000100:00100000:2.0:1789024099.629870:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+26:11302:x1875927402330496:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024099.629890:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024099.629908:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af53b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630028:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630042:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630052:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024099.630066:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789024099.630209:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630217:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630226:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630232:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.630236:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630243:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630338:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.630341:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024099.630426:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630500:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630545:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c0f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af53b expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630561:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:2.0:1789024099.630563:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024099.630567:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af53b expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630577:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5400, rc 0) 00000100:00100000:2.0:1789024099.630649:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+27:11302:x1875927402330496:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 784us (1927us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789024099.630658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 80 00000100:00100000:2.0:1789024099.630696:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422336896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789024099.630751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024099.630815:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422336896 00000100:00100000:2.0:1789024099.630822:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422336896 00000100:00100000:2.0:1789024099.630870:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024099.630878:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422336896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789024099.630903:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789024099.630937:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa25761, atime: 0x6aa25761, ctime: 0x6aa25761, blocks: 0x8 00010000:00010000:2.0:1789024099.630944:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630968:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1789024099.630973:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024099.630979:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.630993:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631002:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631009:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631026:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789024099.631868:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875927422336896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 985us (1111us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789024099.631879:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789024099.631905:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024099.631912:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631923:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024099.631927:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631953:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631970:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631977:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc9d1e3/0xa736ef4b98cb3c24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.631999:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024099.632001:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024099.632003:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789024099.632043:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb038c7800/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789024099.632052:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422336896:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789024099.632141:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789024099.632411:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789024099.639341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.639380:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402330624 00000100:00100000:2.0:1789024099.639389:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402330624 00000100:00100000:2.0:1789024099.639441:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 81 00000100:00100000:2.0:1789024099.639452:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11302:x1875927402330624:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789024099.639488:0:13818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789024099.639619:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11302:x1875927402330624:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 168us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.639627:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 81 00000100:00100000:2.0:1789024099.649538:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.651624:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402330880 00000100:00100000:3.0:1789024099.651645:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402330880 00000100:00100000:3.0:1789024099.651761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 82 00000100:00100000:3.0:1789024099.651777:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11302:x1875927402330880:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024099.651807:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024099.651811:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789024099.651859:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db0c00/0xa736ef4b98cb3bd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af52d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.651901:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024099.651907:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024099.651925:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3c2b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af542 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024099.652592:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789024099.652786:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3c32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.652803:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.652816:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.652901:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3c2b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af542 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.652924:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af542 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.652933:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cb0231a600) 00010000:00010000:3.0:1789024099.652936:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024099.652939:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4600, rc 0) 00000100:00100000:3.0:1789024099.653034:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402330880:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1261us (3506us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789024099.653043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 82 00000100:00100000:3.0:1789024099.666503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.666584:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331136 00000100:00100000:1.0:1789024099.666600:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331136 00000100:00100000:1.0:1789024099.666683:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 83 00000100:00100000:1.0:1789024099.666694:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402331136:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.666758:0:7824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024099.666788:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3c32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af542 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666827:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cb0231a600) 00010000:00010000:1.0:1789024099.666849:0:7824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024099.666876:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666889:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666899:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666949:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666957:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.666963:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667016:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667023:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667029:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667035:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024099.667039:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667052:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667061:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024099.667064:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024099.667068:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667074:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3c40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667085:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667091:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667097:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667102:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024099.667104:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667111:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667118:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1849b78f (ffff90cc33aa9100) 00010000:00010000:1.0:1789024099.667120:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024099.667122:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.667139:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1849b78f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.667278:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11302:x1875927402331136:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 584us (787us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789024099.667286:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 83 00000100:00100000:3.0:1789024099.674032:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.674942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331264 00000100:00100000:0.0:1789024099.674960:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331264 00000100:00100000:0.0:1789024099.675033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 84 00000100:00100000:0.0:1789024099.675045:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11302:x1875927402331264:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789024099.675071:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024099.675104:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3c4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af549 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675166:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675181:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675194:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675333:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e600/0xa736ef4b98cb3c4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675363:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.675370:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:0.0:1789024099.675373:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789024099.675376:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ea00, rc 0) 00000100:00100000:0.0:1789024099.675454:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402331264:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 411us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.675463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 84 00000100:00100000:3.0:1789024099.688778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.689663:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331520 00000100:00100000:1.0:1789024099.689680:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331520 00000100:00100000:1.0:1789024099.689745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 85 00000100:00100000:1.0:1789024099.689756:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402331520:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.689862:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.689883:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.689896:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024099.690077:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789024099.690087:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417725939716ns, next at 418725937601ns, rc = 0 00000004:00010000:1.0:1789024099.690135:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027e5119e reply state 000000005d487eb9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.690171:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.690179:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:1.0:1789024099.690194:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789024099.690198:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024099.690316:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11302:x1875927402331520:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 560us (1551us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789024099.690323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 85 00000100:00100000:2.0:1789024099.697359:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.697415:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331648 00000100:00100000:2.0:1789024099.697424:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331648 00000100:00100000:2.0:1789024099.697499:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 86 00000100:00100000:2.0:1789024099.697509:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11302:x1875927402331648:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024099.697532:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024099.697553:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af550 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.697613:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 17 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.697628:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 17 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.697646:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:2.0:1789024099.697649:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024099.697653:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5400, rc 0) 00000100:00100000:2.0:1789024099.697704:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11302:x1875927402331648:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 198us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.697711:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 86 00000100:00100000:2.0:1789024099.701621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.703633:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331776 00000100:00100000:0.0:1789024099.703648:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331776 00000100:00100000:0.0:1789024099.703701:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:0.0:1789024099.703710:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875927402331776:12345-192.168.202.18@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789024099.703743:0:8433:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:0.0:1789024099.703773:0:8433:0:(genops.c:1384:class_connect()) connect: client 382f7d83-ada1-4b7e-b952-8068d9fee082, cookie 0xa736ef4b98cb3c6a 00002000:00100000:0.0:1789024099.703783:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 382f7d83-ada1-4b7e-b952-8068d9fee082/ffff90cb0395f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789024099.703793:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789024099.703878:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789024099.703911:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90cc1b297800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024099.703987:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2399:x1875927402331776:12345-192.168.202.18@tcp:8:lhsmtool_posix.0 Request processed in 278us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.703995:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:3.0:1789024099.707982:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.709998:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402331904 00000100:00100000:1.0:1789024099.710016:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402331904 00000100:00100000:1.0:1789024099.710120:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00080000:3.0:1789024099.710137:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024099.710137:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+6:0:x1875927402331904:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1789024099.719420:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789024099.719445:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000100:00100000:1.0:1789024099.722105:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:0:x1875927402331904:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 11965us (14127us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789024099.722121:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:3.0:1789024099.724897:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.725069:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402332160 00000100:00100000:1.0:1789024099.725085:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402332160 00000100:00100000:3.0:1789024099.726556:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:3.0:1789024099.726578:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11302:x1875927402332160:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789024099.726942:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11302:x1875927402332160:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 372us (2059us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789024099.726950:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:0.0:1789024099.729284:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.729351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402332416 00000100:00100000:1.0:1789024099.729365:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402332416 00000100:00100000:1.0:1789024099.729437:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 87 00000100:00100000:1.0:1789024099.729449:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11302:x1875927402332416:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789024099.729595:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11302:x1875927402332416:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 148us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.729603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 87 00000100:00100000:1.0:1789024099.735250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.738682:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402332544 00000100:00100000:3.0:1789024099.738698:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402332544 00000100:00100000:3.0:1789024099.738793:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 88 00000100:00100000:3.0:1789024099.738808:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11302:x1875927402332544:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024099.738830:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024099.738868:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3c71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af557 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.738943:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.738961:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.738976:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024099.739036:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024099.739060:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.739087:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3c71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af557 expref: 20 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.739105:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af557 expref: 19 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.739112:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:3.0:1789024099.739115:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789024099.739119:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5400, rc 0) 00000100:00100000:3.0:1789024099.739250:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11302:x1875927402332544:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 447us (4013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.739261:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 88 00000100:00100000:1.0:1789024099.745278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.745342:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402332672 00000100:00100000:1.0:1789024099.745355:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402332672 00000100:00100000:1.0:1789024099.745429:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:1.0:1789024099.745443:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402332672:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.745483:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024099.745514:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af55e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024099.745552:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa25764, blocks: 0x0 00010000:00010000:1.0:1789024099.745580:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1789024099.745585:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024099.745597:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.745622:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.745641:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55400, rc 0) 00000100:00100000:1.0:1789024099.745720:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402332672:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 281us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.745730:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:1.0:1789024099.752445:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.752514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402332928 00000100:00100000:1.0:1789024099.752527:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402332928 00000100:00100000:1.0:1789024099.752606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 89 00000100:00100000:1.0:1789024099.752621:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11302:x1875927402332928:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789024099.752755:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11302:x1875927402332928:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.752766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 89 00000100:00100000:1.0:1789024099.757629:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.758662:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333056 00000100:00100000:3.0:1789024099.758678:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333056 00000100:00100000:3.0:1789024099.758766:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:3.0:1789024099.758784:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:11302:x1875927402333056:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024099.758804:0:8904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024099.758829:0:8904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af565 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.758876:0:8904:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.758902:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024099.758906:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024099.758913:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 7 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.758970:0:8904:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.758985:0:8904:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 7 pid: 8432 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024099.759000:0:8904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8904:1875927422337024:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024099.759119:0:8904:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789024099.766892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.766943:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333184 00000100:00100000:1.0:1789024099.766952:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333184 00010000:00010000:1.0:1789024099.766993:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 8 pid: 8432 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.767031:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:1.0:1789024099.767041:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402333184:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024099.767058:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024099.767081:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 8 pid: 8432 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.767095:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 8 pid: 8432 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.767121:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024099.767125:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024099.767134:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.767169:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.767215:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.767252:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875927422337152:192.168.202.18@tcp:105: 00000100:00100000:1.0:1789024099.767327:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908d80 going to sleep for 11 seconds 00010000:00010000:2.0:1789024099.767544:0:8904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003878c751/0xa736ef4b98cb3c7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af55e expref: 8 pid: 8432 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.767564:0:8904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8904:1875927422337024:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024099.767588:0:8904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 7 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.767612:0:8904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4c00, rc 0) 00000100:00100000:2.0:1789024099.767651:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11302:x1875927402333056:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 8876us (10044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.767657:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:3.0:1789024099.769702:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021d3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1875927422337152:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024099.769728:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024099.769788:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402333184:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 2748us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.769799:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:1.0:1789024099.771711:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.771802:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333312 00000100:00100000:2.0:1789024099.771814:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333312 00002000:00100000:2.0:1789024099.771880:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90cb021d2d80 x1875927402333312/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:270/0 lens 504/0 e 0 to 0 dl 1789024110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024099.771892:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb021d2d80 with x1875927402333312 ext(0->8) 00002000:00010000:2.0:1789024099.771899:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cb021d2d80 00000100:00100000:2.0:1789024099.772068:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:2.0:1789024099.772080:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402333312:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789024099.777075:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402333312:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 Request processed in 4984us (5360us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789024099.777091:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00002000:00100000:2.0:1789024099.777102:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90cb021d2d80 x1875927402333312/t4294967303(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:270/0 lens 504/448 e 0 to 0 dl 1789024110 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024099.777112:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb021d2d80 with x1875927402333312 ext(0->8) 00002000:00010000:2.0:1789024099.777119:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cb021d2d80 00000100:00100000:3.0:1789024099.788431:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.788498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333440 00000100:00100000:0.0:1789024099.788514:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333440 00000100:00100000:0.0:1789024099.788592:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 90 00000100:00100000:0.0:1789024099.788605:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11302:x1875927402333440:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789024099.791802:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1789024099.791831:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789024099.791858:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789024099.791889:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789024099.791890:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.791907:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789024099.791914:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789024099.791917:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.791925:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024099.791932:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.791942:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.791965:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:0.0:1789024099.791969:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789024099.791976:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.791985:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c5c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024099.792214:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422337280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789024099.792335:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024099.792391:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422337280 00000100:00100000:1.0:1789024099.792409:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422337280 00000100:00100000:1.0:1789024099.792485:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789024099.792496:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422337280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789024099.792628:0:10202:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789024099.792632:0:10202:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789024100 00002000:00010000:1.0:1789024099.792635:0:10202:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789024099.792637:0:10202:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789024100 -> 1789024100 00002000:00010000:1.0:1789024099.792640:0:10202:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789024099.792715:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422337280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (382us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789024099.792722:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1789024099.792983:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb039e9880/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789024099.792994:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422337280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789024099.793372:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402333440:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 Request processed in 4766us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.793399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 90 00000100:00100000:1.0:1789024099.801069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.801142:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333568 00000100:00100000:0.0:1789024099.801254:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333568 00000100:00100000:0.0:1789024099.801346:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:0.0:1789024099.801359:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402333568:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789024099.804979:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789024099.804995:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789024099.805238:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402333568:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 Request processed in 3874us (4171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.805250:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:2.0:1789024099.817627:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.817731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333824 00000100:00100000:1.0:1789024099.817750:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333824 00000100:00100000:1.0:1789024099.817832:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 91 00000100:00100000:1.0:1789024099.817858:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402333824:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.817916:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024099.817961:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3c78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af557 expref: 14 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.817983:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:1.0:1789024099.817988:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024099.818022:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.818037:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.818047:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024099.818327:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fba9168b reply state 000000004125aa59 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.818341:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.818350:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:1.0:1789024099.818355:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024099.818358:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024099.818492:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+15:11302:x1875927402333824:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 636us (881us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789024099.818499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 91 00000100:00100000:2.0:1789024099.828806:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.828935:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402333952 00000100:00100000:3.0:1789024099.828952:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402333952 00000100:00100000:3.0:1789024099.829029:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:3.0:1789024099.829043:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402333952:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789024099.829328:0:8904:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789024099.829332:0:8904:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789024100 -> 1789024098 00002000:00010000:3.0:1789024099.829335:0:8904:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789024097 00002000:00010000:3.0:1789024099.829337:0:8904:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789024100 -> 1789024098 00002000:00010000:3.0:1789024099.829339:0:8904:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789024099.829474:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402333952:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 433us (684us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789024099.829485:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:2.0:1789024099.833536:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.833653:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334208 00000100:00100000:1.0:1789024099.833668:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334208 00000100:00100000:1.0:1789024099.833728:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 92 00000100:00100000:1.0:1789024099.833739:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+15:11302:x1875927402334208:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.833910:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.833928:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.833938:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.833971:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.833984:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 15 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.833998:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422337408:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024099.834095:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024099.837473:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422337408:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024099.837505:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.838998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024099.840475:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334336 00000100:00100000:3.0:1789024099.840488:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334336 00010000:00010000:3.0:1789024099.840532:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024099.840631:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:3.0:1789024099.840641:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+16:2402:x1875927402334336:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024099.840655:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024099.840662:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840692:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840714:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af549 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840730:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:3.0:1789024099.840735:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840743:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840816:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.840864:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024099.840936:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+15:2402:x1875927402334336:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 296us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.840944:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00010000:00010000:1.0:1789024099.841009:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841018:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841058:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841076:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841082:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841088:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024099.841093:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841101:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841111:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:1.0:1789024099.841113:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789024099.841117:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.841122:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3c94 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.841224:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402334208:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 Request processed in 7487us (7700us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789024099.841232:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 92 00000100:00100000:2.0:1789024099.844880:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.845084:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334464 00000100:00100000:1.0:1789024099.845098:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334464 00000100:00100000:1.0:1789024099.845307:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:1.0:1789024099.845319:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2400:x1875927402334464:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789024099.845378:0:10202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.845410:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 7 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.845420:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024099.845425:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024099.845429:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.845472:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 7 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.845486:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 7 pid: 8904 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.845502:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422337536:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024099.845597:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024099.849917:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.851077:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422337536:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024099.851109:0:10202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024099.851515:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334592 00000100:00100000:3.0:1789024099.851523:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334592 00010000:00010000:3.0:1789024099.851559:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024099.851600:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:3.0:1789024099.851609:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402334592:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024099.851639:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024099.851660:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.851672:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.851697:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3c86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af565 expref: 8 pid: 8904 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.851712:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024099.851716:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024099.851722:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.851731:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024099.851825:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024099.851895:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402334592:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 286us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024099.851902:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 61 00010000:00010000:2.0:1789024099.857285:0:10202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857306:0:10202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857339:0:10202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857348:0:10202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857357:0:10202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857364:0:10202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024099.857369:0:10202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857377:0:10202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857423:0:10202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.857431:0:10202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a225beb4/0xa736ef4b98cb3c9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.857583:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402334464:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 Request processed in 12261us (12708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.857594:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:1.0:1789024099.862571:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.862633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334848 00000100:00100000:0.0:1789024099.862644:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334848 00000100:00100000:0.0:1789024099.862707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 93 00000100:00100000:0.0:1789024099.862717:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11302:x1875927402334848:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789024099.862797:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.862816:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.862825:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.862880:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.862895:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 14 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024099.862909:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422337664:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024099.863005:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789024099.869470:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422337664:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024099.869500:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.871753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024099.871885:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402334976 00000100:00100000:2.0:1789024099.871895:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402334976 00010000:00010000:2.0:1789024099.871944:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 15 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.871989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:2.0:1789024099.871999:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+15:2403:x1875927402334976:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024099.872015:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024099.872023:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 15 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872037:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 15 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872059:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3ae2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af4ee expref: 15 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872096:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.872101:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872111:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872118:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.872196:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024099.872253:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f194450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+14:2403:x1875927402334976:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 254us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024099.872260:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 62 00010000:00010000:0.0:1789024099.872527:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872536:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872714:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872729:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 14 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872738:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872767:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 14 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.872781:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 14 pid: 7824 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024099.872795:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422337792:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024099.872870:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789024099.888989:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422337792:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024099.889022:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024099.889124:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.893221:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402335104 00000100:00100000:1.0:1789024099.893248:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402335104 00010000:00010000:1.0:1789024099.893329:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 15 pid: 7824 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024099.893662:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:0.0:1789024099.893676:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+15:2403:x1875927402335104:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024099.893695:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024099.893703:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 15 pid: 7824 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893719:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 15 pid: 7824 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893747:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3c63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af550 expref: 15 pid: 7824 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893769:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:0.0:1789024099.893775:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893785:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893793:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.893897:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024099.893972:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:2403:x1875927402335104:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 300us (4848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.893981:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00010000:00010000:2.0:1789024099.900084:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.900103:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024099.900379:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789024099.900520:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789024099.900559:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789024099.900659:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875927422337920:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789024099.900747:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024099.900870:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514540 going to sleep for 11 seconds 00000100:00100000:1.0:1789024099.904084:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422337920 00000100:00100000:1.0:1789024099.904101:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422337920 00000100:00100000:0.0:1789024099.904502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789024099.904514:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1875927422337920:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789024099.904665:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6515:x1875927422337920:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024099.904673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789024099.904763:0:6515:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789024099.904770:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb039e9880, transno 4294967304 00000100:00100000:2.0:1789024099.904790:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875927422337920:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789024099.904956:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789024099.905031:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875927422338048:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789024099.905070:0:6515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024099.905109:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024099.905407:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422338048 00000100:00100000:1.0:1789024099.905413:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422338048 00000100:00100000:1.0:1789024099.905452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789024099.905461:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875927422338048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789024099.905572:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1875927422338048:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (500us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789024099.905579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789024099.905694:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875927422338048:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789024099.905735:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905745:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905753:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905760:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.905764:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905772:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905787:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:2.0:1789024099.905790:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024099.905795:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb3ca9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905916:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905923:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905929:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905934:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.905937:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905943:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905953:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.905955:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024099.905959:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905963:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3bd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905986:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.905999:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.906014:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.906039:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.906053:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 17 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.906064:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422338176:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024099.906136:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789024099.908943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024099.909096:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402335232 00000100:00100000:1.0:1789024099.909105:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402335232 00010000:00010000:1.0:1789024099.909175:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 18 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024099.909216:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:1.0:1789024099.909226:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402335232:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024099.909239:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024099.909247:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 18 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.909260:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 18 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.909280:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:1.0:1789024099.909285:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.909293:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.909299:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.909337:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024099.909398:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402335232:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 173us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024099.909406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00010000:00010000:2.0:1789024099.909619:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb3bf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af534 expref: 17 pid: 6515 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.909639:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422338176:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024099.909664:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909674:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909681:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909695:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909703:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909719:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909725:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.909729:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909737:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909747:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.909751:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024099.909755:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909761:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3cb0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909772:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909777:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909782:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909788:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024099.909791:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909806:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909814:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc33aa9500) 00010000:00010000:2.0:1789024099.909816:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789024099.909819:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024099.909825:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3ca2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024099.909998:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11302:x1875927402334848:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 47282us (47435us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789024099.910008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 93 00000020:00080000:2.0:1789024099.910012:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789024099.910252:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024099.910257:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024099.910274:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789024099.910281:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789024099.912300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024099.912663:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402335488 00000100:00100000:0.0:1789024099.912675:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402335488 00000100:00100000:0.0:1789024099.912789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:0.0:1789024099.912802:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11302:x1875927402335488:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789024099.913094:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789024099.913135:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1789024099.913240:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913260:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913275:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913285:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913292:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913298:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024099.913312:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789024099.913445:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11302:x1875927402335488:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 644us (1152us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789024099.913470:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000020:00080000:0.0:1789024099.913475:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789024099.913556:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024099.913566:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.913575:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024099.913580:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.913588:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.913601:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:1.0:1789024099.913603:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789024099.913608:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.913614:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb3cb7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024099.913628:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024099.913630:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024099.913631:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024100.173429:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024100.749473:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024100.749502:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422338304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024100.749575:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024100.749791:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422338304 00000100:00100000:1.0:1789024100.749800:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422338304 00000100:00100000:1.0:1789024100.749862:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789024100.749872:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422338304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024100.749906:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789024100.749965:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422338304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024100.749973:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789024100.750074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422338304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024101.233328:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789024101.610092:0:14261:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024101.610108:0:14261:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024101.610140:0:14261:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789024101.610180:0:14261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789024101.891934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024101.892044:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402335744 00000100:00100000:3.0:1789024101.892058:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402335744 00000100:00100000:3.0:1789024101.892197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00100000:3.0:1789024101.892212:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11319:x1875927402335744:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024101.892248:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024101.892279:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af56c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.892443:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3cc5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.892462:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.892477:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024101.892505:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789024101.892648:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af56c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.892672:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af56c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.892683:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024101.892687:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024101.892691:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4e00, rc 0) 00000100:00100000:3.0:1789024101.892767:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11319:x1875927402335744:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 559us (848us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789024101.892797:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00080000:2.0:1789024101.893088:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024101.898417:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024101.906172:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402335872 00000100:00100000:3.0:1789024101.906196:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402335872 00000100:00100000:3.0:1789024101.906329:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 95 00000100:00100000:3.0:1789024101.906343:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11319:x1875927402335872:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:3.0:1789024101.906470:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906502:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906518:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906541:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906548:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906555:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906672:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906680:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906687:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024101.906781:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906797:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906805:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906812:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906831:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024101.906836:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906844:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906859:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024101.906862:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024101.906868:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906874:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3cd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906891:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906896:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906909:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.906915:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024101.906918:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907793:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907810:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cb02319400) 00010000:00010000:3.0:1789024101.907813:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024101.907827:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907833:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3cda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907858:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907864:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907871:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907877:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024101.907879:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907906:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.907915:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cb02319000) 00010000:00010000:3.0:1789024101.907917:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024101.907920:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024101.908377:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3ce1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024101.908535:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11319:x1875927402335872:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 2187us (10126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024101.908546:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 95 00000100:00100000:3.0:1789024101.995773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024101.996331:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402336128 00000100:00100000:2.0:1789024101.996352:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402336128 00000100:00100000:2.0:1789024101.996529:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 96 00000100:00100000:2.0:1789024101.996542:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11323:x1875927402336128:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024101.996571:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024101.996599:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3ce8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af573 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996681:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996716:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996731:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996747:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996753:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996759:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996904:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996913:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.996921:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024101.996932:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789024101.997016:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997023:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997031:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997043:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024101.997047:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997055:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997068:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024101.997071:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024101.997077:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.997084:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3cef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998261:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998274:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998281:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998286:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024101.998290:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998298:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998326:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc351ffb00) 00010000:00010000:2.0:1789024101.998329:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024101.998333:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998339:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3cf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998417:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3ce8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998432:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024101.998439:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:2.0:1789024101.998442:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024101.998445:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:2.0:1789024101.998579:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11323:x1875927402336128:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 2039us (2822us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789024101.998587:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 96 00000100:00100000:2.0:1789024102.007319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.007470:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402336256 00000100:00100000:0.0:1789024102.007484:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402336256 00000100:00100000:0.0:1789024102.007581:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 97 00000100:00100000:0.0:1789024102.007593:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11323:x1875927402336256:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:0.0:1789024102.007670:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007686:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007698:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007735:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007743:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007750:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007757:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.007775:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007796:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007809:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.007813:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024102.007827:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.007834:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.007928:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11323:x1875927402336256:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 336us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.007936:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 97 00000100:00100000:0.0:1789024102.010981:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.011083:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402336512 00000100:00100000:3.0:1789024102.011103:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402336512 00000100:00100000:3.0:1789024102.011215:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024102.011226:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11323:x1875927402336512:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024102.011496:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+23:11323:x1875927402336512:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 272us (721us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789024102.011504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024102.073242:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.073426:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402336768 00000100:00100000:1.0:1789024102.073445:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402336768 00000100:00100000:1.0:1789024102.073542:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 98 00000100:00100000:1.0:1789024102.073554:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+23:10839:x1875927402336768:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024102.073582:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.073609:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af57a expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.073735:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.073753:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.073761:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.073799:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.073813:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.073856:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422338432:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024102.073993:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908180 going to sleep for 11 seconds 00000100:00100000:2.0:1789024102.081518:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.081795:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402336896 00000100:00100000:0.0:1789024102.081807:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402336896 00010000:00010000:0.0:1789024102.081872:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.081917:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:0.0:1789024102.081928:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:2402:x1875927402336896:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024102.081946:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024102.081953:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.081967:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 25 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.082004:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.082010:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.082020:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.082027:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.082046:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024102.082107:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:2402:x1875927402336896:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 182us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.082115:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 65 00010000:00010000:1.0:1789024102.084910:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3cfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af573 expref: 24 pid: 6515 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.084944:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422338432:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024102.084972:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.084982:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.084989:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024102.085007:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789024102.085136:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 25 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.085185:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 24 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.085194:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.085197:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789024102.085200:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55600, rc 0) 00000100:00100000:1.0:1789024102.085260:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+24:10839:x1875927402336768:12345-192.168.202.18@tcp:101:bash.0 Request processed in 11709us (12044us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789024102.085284:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 98 00000100:00100000:2.0:1789024102.088666:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.088768:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337024 00000100:00100000:0.0:1789024102.088777:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337024 00000100:00100000:0.0:1789024102.088865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:0.0:1789024102.088875:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+24:10839:x1875927402337024:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:0.0:1789024102.088900:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024102.088919:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af581 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.088956:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3d2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.088968:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.088978:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.089098:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af581 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.089116:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3d2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af581 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.089125:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.089128:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789024102.089131:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e200, rc 0) 00000100:00100000:0.0:1789024102.089224:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:10839:x1875927402337024:12345-192.168.202.18@tcp:101:bash.0 Request processed in 350us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.089232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:2.0:1789024102.092959:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.093695:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337280 00000100:00100000:0.0:1789024102.093706:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337280 00000100:00100000:0.0:1789024102.093771:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 100 00000100:00100000:0.0:1789024102.093783:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+25:10839:x1875927402337280:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:0.0:1789024102.094093:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.094112:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.094125:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024102.094260:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789024102.094288:0:13818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005b54f6d reply state 000000007606acb9 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.094319:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.094325:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.094328:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789024102.094331:0:13818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789024102.094475:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789024102.094628:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+29:10839:x1875927402337280:12345-192.168.202.18@tcp:36:bash.0 Request processed in 845us (1675us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789024102.094636:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 100 00000020:00080000:0.0:1789024102.094641:0:13818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789024102.096986:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.097453:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337408 00000100:00100000:1.0:1789024102.097467:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337408 00000100:00100000:1.0:1789024102.097522:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:1.0:1789024102.097530:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+29:10839:x1875927402337408:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024102.097549:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.097567:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3d3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af588 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.097613:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3d3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af588 expref: 30 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.097623:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3d3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af588 expref: 30 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.097636:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.097638:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024102.097641:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54200, rc 0) 00000100:00100000:1.0:1789024102.097687:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+30:10839:x1875927402337408:12345-192.168.202.18@tcp:101:bash.0 Request processed in 159us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.097692:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:2.0:1789024102.100659:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.100702:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337536 00000100:00100000:1.0:1789024102.100714:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337536 00000100:00080000:2.0:1789024102.100776:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024102.100907:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:1.0:1789024102.100919:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:10839:x1875927402337536:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024102.100940:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.100971:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af58f expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024102.100996:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa25762, atime: 0x6aa25761, ctime: 0x6aa25762, blocks: 0x8 00010000:00010000:1.0:1789024102.101327:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1789024102.101334:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024102.101344:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.101364:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.101378:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54800, rc 0) 00000100:00100000:1.0:1789024102.101435:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:10839:x1875927402337536:12345-192.168.202.18@tcp:101:bash.0 Request processed in 519us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.101440:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:2.0:1789024102.103727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.103872:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337664 00000100:00100000:0.0:1789024102.103882:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337664 00002000:00010000:0.0:1789024102.103923:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789024102.103928:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc07f3a680 with x1875927402337664 ext(0->18446744073709551615) 00002000:00010000:0.0:1789024102.103941:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc07f3a680. 00000100:00100000:0.0:1789024102.103969:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:0.0:1789024102.103979:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402337664:12345-192.168.202.18@tcp:10:bash.0 00002000:00010000:0.0:1789024102.104460:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789024102.104465:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789024098 -> 1789024102 00002000:00010000:0.0:1789024102.104467:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789024097 -> 1789024097 00002000:00010000:0.0:1789024102.104469:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789024098 -> 1789024102 00002000:00010000:0.0:1789024102.104471:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789024102.104570:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402337664:12345-192.168.202.18@tcp:10:bash.0 Request processed in 591us (850us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789024102.104579:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00002000:00010000:0.0:1789024102.104598:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1789024102.104601:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc07f3a680 with x1875927402337664 ext(0->18446744073709551615) 00002000:00010000:0.0:1789024102.104606:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc07f3a680. 00000100:00100000:2.0:1789024102.187920:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.188035:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402337792 00000100:00100000:0.0:1789024102.188048:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402337792 00000100:00100000:0.0:1789024102.188123:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 102 00000100:00100000:0.0:1789024102.188135:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11337:x1875927402337792:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:0.0:1789024102.188278:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188297:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188309:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188326:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188333:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188339:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188418:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188427:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188434:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024102.188495:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188506:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188512:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188518:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188523:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.188527:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188534:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188547:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024102.188549:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.188555:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188560:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188573:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188577:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188589:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188594:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ee00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.188597:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188602:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188610:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc11d52900) 00010000:00010000:0.0:1789024102.188612:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.188615:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188620:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188636:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188643:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188648:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188653:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.188656:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188671:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188679:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.188681:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.188685:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.188690:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.188772:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11337:x1875927402337792:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 638us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.188780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 102 00000100:00100000:2.0:1789024102.235804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.235964:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402338048 00000100:00100000:0.0:1789024102.235976:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402338048 00000100:00100000:0.0:1789024102.236060:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 103 00000100:00100000:0.0:1789024102.236072:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11340:x1875927402338048:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024102.236102:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024102.236130:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af596 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236289:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236309:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236323:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236360:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236368:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236375:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236497:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb3d74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236506:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb3d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236513:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb3d74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024102.236521:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789024102.236601:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236610:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236617:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236625:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ee00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.236631:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236650:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236665:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024102.236668:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.236674:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236681:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb3d66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236698:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236705:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236711:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236717:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.236720:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236727:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236734:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc11d52900) 00010000:00010000:0.0:1789024102.236737:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.236740:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236755:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb3d6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236803:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb3d5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af596 expref: 33 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236831:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb3d74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af596 expref: 32 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.236840:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024102.236842:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789024102.236845:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f800, rc 0) 00000100:00100000:0.0:1789024102.236916:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11340:x1875927402338048:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 847us (1124us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789024102.236925:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 103 00000100:00100000:2.0:1789024102.240435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.240556:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402338176 00000100:00100000:1.0:1789024102.240570:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402338176 00000100:00100000:1.0:1789024102.240632:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 104 00000100:00100000:1.0:1789024102.240644:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11340:x1875927402338176:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:1.0:1789024102.240716:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.240733:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 32 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.240743:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.240790:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 32 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.240805:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 32 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.240836:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422338560:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024102.241003:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908180 going to sleep for 11 seconds 00000100:00100000:3.0:1789024102.244321:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.244426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402338432 00000100:00100000:0.0:1789024102.244437:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402338432 00000100:00100000:0.0:1789024102.244500:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:0.0:1789024102.244510:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+33:9926:x1875927402338432:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789024102.244840:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+34:9926:x1875927402338432:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 330us (530us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789024102.244848:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:1.0:1789024102.245428:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422338560:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024102.245458:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024102.247579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.247674:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402338560 00000100:00100000:1.0:1789024102.247683:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402338560 00010000:00010000:1.0:1789024102.247717:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 34 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.247755:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:1.0:1789024102.247765:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+34:2402:x1875927402338560:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024102.247780:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024102.247787:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 34 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.247799:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 34 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.248035:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af57a expref: 34 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.248055:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.248060:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.248070:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.248078:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.248115:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024102.248387:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+33:2402:x1875927402338560:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 622us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.248396:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 66 00010000:00010000:3.0:1789024102.248804:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248823:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248892:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248899:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248907:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248914:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024102.248918:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248925:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248936:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:3.0:1789024102.248939:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789024102.248943:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.248949:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3d82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024102.249012:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11340:x1875927402338176:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 8370us (8594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024102.249020:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 104 00000100:00100000:2.0:1789024102.252250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.252397:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402338816 00000100:00100000:0.0:1789024102.252415:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402338816 00000100:00100000:0.0:1789024102.252484:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:0.0:1789024102.252495:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:11340:x1875927402338816:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:0.0:1789024102.252766:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+33:11340:x1875927402338816:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 272us (527us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789024102.252774:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00010000:00010000:2.0:1789024102.284735:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024102.349761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.350065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402339072 00000100:00100000:1.0:1789024102.350076:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402339072 00000100:00100000:1.0:1789024102.350267:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 105 00000100:00100000:1.0:1789024102.350279:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+33:11351:x1875927402339072:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:1.0:1789024102.350304:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.350325:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af59d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350417:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350450:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350464:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350480:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350487:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350493:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350626:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3d9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350636:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350643:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3d9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024102.350654:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789024102.350735:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350743:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350750:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350763:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024102.350768:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350776:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350789:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024102.350792:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024102.350796:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350802:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3d90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350839:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350845:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350857:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350862:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024102.350865:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350872:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350890:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:1.0:1789024102.350893:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024102.350896:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350902:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3d97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350961:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3d89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af59d expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350976:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3d9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af59d expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.350984:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.350987:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024102.350989:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54c00, rc 0) 00000100:00100000:1.0:1789024102.351067:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11351:x1875927402339072:12345-192.168.202.18@tcp:101:cat.0 Request processed in 790us (1315us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789024102.351075:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 105 00000100:00100000:0.0:1789024102.355935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.356180:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402339328 00000100:00100000:3.0:1789024102.356194:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402339328 00000100:00100000:3.0:1789024102.356277:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:3.0:1789024102.356314:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11351:x1875927402339328:12345-192.168.202.18@tcp:35:cat.0 00000100:00100000:3.0:1789024102.357067:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+36:11351:x1875927402339328:12345-192.168.202.18@tcp:35:cat.0 Request processed in 750us (1137us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789024102.357076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:2.0:1789024102.379118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.379317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402339584 00000100:00100000:1.0:1789024102.379327:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402339584 00000100:00100000:1.0:1789024102.379439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 106 00000100:00100000:1.0:1789024102.379450:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+36:11352:x1875927402339584:12345-192.168.202.18@tcp:36:rm.0 00010000:00010000:1.0:1789024102.379515:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789024102.379548:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3d3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af588 expref: 36 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379595:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3d9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af59d expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379608:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb3d74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af596 expref: 34 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379620:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb3d2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af581 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379629:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.379635:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024102.379658:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379673:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379682:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379697:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379703:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379709:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379798:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379807:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.379831:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024102.380057:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789024102.380068:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420415920691ns, next at 421415918031ns, rc = 0 00010000:00010000:1.0:1789024102.380112:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380121:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380129:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380136:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380143:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380179:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380203:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789024102.380221:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380233:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380240:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380247:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024102.380252:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380259:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380269:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:1.0:1789024102.380271:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789024102.380275:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380281:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3dba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380297:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380302:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380308:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380313:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024102.380322:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380328:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380335:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024102.380337:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024102.380340:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380346:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3dac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024102.380357:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055ab95eb reply state 0000000061a8eada transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380367:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.380373:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:1.0:1789024102.380375:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024102.380377:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024102.380460:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+34:11352:x1875927402339584:12345-192.168.202.18@tcp:36:rm.0 Request processed in 1010us (1351us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789024102.380468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 106 00010000:00010000:2.0:1789024102.380542:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024102.380548:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.380555:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024102.380559:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.380565:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.380574:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:2.0:1789024102.380576:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789024102.380579:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.380584:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3dc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.380594:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024102.380596:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024102.380597:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024102.429978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.430079:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402339840 00000100:00100000:3.0:1789024102.430093:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402339840 00000100:00100000:3.0:1789024102.430228:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:3.0:1789024102.430242:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+34:11358:x1875927402339840:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024102.430274:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024102.430301:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3dc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5a4 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430634:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430652:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430665:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430677:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430686:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.430692:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024102.431436:0:7824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789024102.431586:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431596:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431604:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431636:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431644:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431650:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431655:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024102.431659:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431666:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431677:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024102.431680:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024102.431684:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431702:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3dcf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024102.431715:0:7824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a309aef reply state 000000007b4e09bd transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431726:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431732:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:3.0:1789024102.431734:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024102.431737:0:7824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789024102.431768:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3dc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 37 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431781:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 36 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.431788:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:3.0:1789024102.431791:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024102.431793:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4c00, rc 0) 00000100:00100000:3.0:1789024102.432597:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+37:11358:x1875927402339840:12345-192.168.202.18@tcp:101:bash.0 Request processed in 2356us (2627us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789024102.432607:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:0.0:1789024102.437673:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.437774:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402339968 00000100:00100000:1.0:1789024102.437785:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402339968 00000100:00100000:1.0:1789024102.437997:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:1.0:1789024102.438008:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402339968:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024102.438028:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.438069:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5ab expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024102.438093:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024102.438117:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1789024102.438121:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024102.438131:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.438301:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.438316:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55600, rc 0) 00000100:00100000:1.0:1789024102.438441:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402339968:12345-192.168.202.18@tcp:101:bash.0 Request processed in 433us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.438448:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:3.0:1789024102.441351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.441433:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402340096 00000100:00100000:1.0:1789024102.441442:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402340096 00000100:00100000:1.0:1789024102.441496:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:1.0:1789024102.441505:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+8:11358:x1875927402340096:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024102.441525:0:10202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.441545:0:10202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5b2 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.441578:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.441607:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024102.441611:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024102.441617:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 9 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.441654:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.441666:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.441682:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10202:1875927422338688:192.168.202.18@tcp:104: 00000100:00080000:2.0:1789024102.441784:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024102.441998:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024102.444644:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10202:1875927422338688:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024102.444699:0:10202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 9 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.444726:0:10202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54600, rc 0) 00000100:00100000:1.0:1789024102.444794:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+9:11358:x1875927402340096:12345-192.168.202.18@tcp:101:bash.0 Request processed in 3289us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.444805:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:0.0:1789024102.447636:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.447751:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402340224 00000100:00100000:3.0:1789024102.447761:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402340224 00010000:00010000:3.0:1789024102.447805:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024102.448027:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:3.0:1789024102.448038:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2403:x1875927402340224:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024102.448054:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024102.448077:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.448091:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.448118:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb64a4a/0xa736ef4b98cb3deb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ab expref: 9 pid: 8432 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.448139:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024102.448252:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024102.448263:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.448275:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.448333:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024102.448347:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875927422338816:192.168.202.18@tcp:105: 00000100:00100000:3.0:1789024102.448432:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5000 going to sleep for 11 seconds 00000100:00100000:3.0:1789024102.451878:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875927422338816:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024102.451910:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024102.451984:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402340224:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 3945us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024102.451999:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:0.0:1789024102.455214:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.455687:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402340480 00000100:00100000:2.0:1789024102.455698:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402340480 00000100:00100000:2.0:1789024102.455764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024102.455776:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+37:11358:x1875927402340480:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:2.0:1789024102.456123:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11358:x1875927402340480:12345-192.168.202.18@tcp:35:bash.0 Request processed in 349us (919us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789024102.456131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:0.0:1789024102.669978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.670105:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402340608 00000100:00100000:1.0:1789024102.670117:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402340608 00000100:00100000:1.0:1789024102.670291:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:1.0:1789024102.670317:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+38:11374:x1875927402340608:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024102.670344:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.670365:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670566:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670583:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670594:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024102.670636:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789024102.670640:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024102.670659:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670684:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b9 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670701:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b9 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.670709:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024102.670711:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789024102.670714:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54200, rc 0) 00000100:00100000:1.0:1789024102.670784:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+39:11374:x1875927402340608:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 468us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.670799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:0.0:1789024102.676794:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.676889:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402340864 00000100:00100000:1.0:1789024102.676900:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402340864 00000100:00100000:1.0:1789024102.676957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 109 00000100:00100000:1.0:1789024102.676965:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+39:11374:x1875927402340864:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024102.676984:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.677002:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3e07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5c0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.677108:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3e0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.677122:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.677134:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024102.677165:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789024102.677272:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3e07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c0 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.677291:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3e0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c0 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.677300:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:1.0:1789024102.677302:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024102.677306:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55600, rc 0) 00000100:00100000:1.0:1789024102.677395:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+41:11374:x1875927402340864:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 429us (612us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789024102.677402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 109 00000100:00100000:3.0:1789024102.682681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.682726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.682821:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341120 00000100:00100000:1.0:1789024102.682833:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341120 00000100:00100000:1.0:1789024102.682897:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 110 00000100:00100000:1.0:1789024102.682907:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+41:11374:x1875927402341120:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024102.682930:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.682951:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3e1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5c7 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.683054:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.683068:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.683079:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024102.683090:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789024102.683222:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3e1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c7 expref: 44 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.683238:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c7 expref: 43 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.683246:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:1.0:1789024102.683248:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789024102.683263:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a55200, rc 0) 00000100:00100000:1.0:1789024102.683314:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+43:11374:x1875927402341120:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 408us (647us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789024102.683320:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 110 00000100:00100000:2.0:1789024102.683621:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341248 00000100:00100000:2.0:1789024102.683626:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341248 00000100:00100000:2.0:1789024102.683670:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:2.0:1789024102.683676:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+43:2403:x1875927402341248:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024102.683686:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024102.683700:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3e0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c0 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.683711:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:2.0:1789024102.683714:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024102.683748:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+42:2403:x1875927402341248:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 72us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024102.683754:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:3.0:1789024102.699748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.699865:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341376 00000100:00100000:1.0:1789024102.699884:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341376 00000100:00100000:1.0:1789024102.699945:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:1.0:1789024102.699954:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2400:x1875927402341376:12345-192.168.202.18@tcp:1:lfs.0 00010000:00010000:1.0:1789024102.699999:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.700021:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.700030:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024102.700035:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024102.700040:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.700078:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.700092:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 8 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.700107:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875927422338944:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024102.700269:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908540 going to sleep for 11 seconds 00000100:00100000:3.0:1789024102.707039:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.707682:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341504 00000100:00100000:2.0:1789024102.707692:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341504 00002000:00100000:2.0:1789024102.707746:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90cb03bef480 x1875927402341504/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:273/0 lens 504/0 e 0 to 0 dl 1789024113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024102.707759:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb03bef480 with x1875927402341504 ext(0->8) 00010000:00010000:2.0:1789024102.707768:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 9 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.707799:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 9 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024102.707807:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cb03bef480 00000100:00100000:2.0:1789024102.707855:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:2.0:1789024102.707866:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402341504:12345-192.168.202.18@tcp:4:lfs.0 00000100:00100000:1.0:1789024102.711167:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875927422338944:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024102.711202:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024102.711348:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2402:x1875927402341504:12345-192.168.202.18@tcp:4:lfs.0 Request processed in 3481us (4317us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789024102.711359:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00002000:00100000:2.0:1789024102.711371:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90cb03bef480 x1875927402341504/t4294967303(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:273/0 lens 504/448 e 0 to 0 dl 1789024113 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024102.712489:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb03bef480 with x1875927402341504 ext(0->8) 00010000:00010000:2.0:1789024102.712509:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 11 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.712532:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 11 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024102.712542:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cb03bef480 00000001:00080000:2.0:1789024102.717017:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1789024102.717041:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789024102.719110:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.719253:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341632 00000100:00100000:1.0:1789024102.719264:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341632 00010000:00010000:1.0:1789024102.719306:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 7 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.719348:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:1.0:1789024102.719357:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402341632:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024102.719371:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789024102.719390:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789024102.719394:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789024103 00002000:00010000:1.0:1789024102.719396:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789024103 00002000:00010000:1.0:1789024102.719398:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789024103 00002000:00010000:1.0:1789024102.719400:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789024102.719407:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 7 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.719423:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 7 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.719459:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd008ae3/0xa736ef4b98cb3df2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b2 expref: 7 pid: 10202 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.719495:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024102.719499:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024102.719506:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.719515:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.719556:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024102.719689:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f196850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402341632:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 332us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.719700:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00010000:00010000:0.0:1789024102.720093:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720104:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720123:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720129:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720137:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720189:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024102.720194:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720202:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720215:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.720222:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082d3a857/0xa736ef4b98cb3e31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.720279:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402341376:12345-192.168.202.18@tcp:1:lfs.0 Request processed in 20326us (20542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.720286:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:0.0:1789024102.722694:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024102.722776:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402341888 00000100:00100000:3.0:1789024102.722789:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402341888 00000100:00100000:3.0:1789024102.722915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:3.0:1789024102.722926:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+42:11374:x1875927402341888:12345-192.168.202.18@tcp:35:lfs.0 00000004:00010000:3.0:1789024102.723000:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c7 expref: 42 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789024102.723271:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789024102.723301:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789024102.723632:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789024102.723670:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.723686:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 46 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.723696:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.723747:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 46 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.723764:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 46 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024102.723781:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875927422339072:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024102.723893:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb024d5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789024102.731018:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875927422339072:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024102.731068:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.744124:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.744822:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342016 00000100:00100000:2.0:1789024102.744832:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342016 00010000:00010000:2.0:1789024102.744874:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 47 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024102.744919:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:2.0:1789024102.744928:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+47:2403:x1875927402342016:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024102.744942:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024102.744948:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 47 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.744959:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 47 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.744979:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ddd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5a4 expref: 47 pid: 7824 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.744995:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:2.0:1789024102.745000:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.745009:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.745015:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.745049:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024102.745115:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+46:2403:x1875927402342016:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 188us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024102.745123:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 69 00010000:00010000:0.0:1789024102.745555:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.745565:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024102.745692:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789024102.745821:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789024102.745911:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422339200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789024102.745960:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024102.745997:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789024102.746057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422339200 00000100:00100000:3.0:1789024102.746063:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422339200 00000100:00100000:3.0:1789024102.746119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789024102.746127:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875927422339200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789024102.746253:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875927422339200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 127us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024102.746261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789024102.746302:0:6518:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1789024102.746308:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1789024102.746329:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb038c7800, transno 4294967302 00000100:00100000:3.0:1789024102.746342:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012aed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422339200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789024102.746449:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789024102.746490:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422339328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789024102.746517:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024102.746532:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc0133ae40 going to sleep for 11 seconds 00000100:00080000:0.0:1789024102.746867:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024102.746881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422339328 00000100:00100000:0.0:1789024102.746886:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422339328 00000100:00100000:0.0:1789024102.746924:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789024102.746931:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1875927422339328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789024102.747044:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1875927422339328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 113us (526us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789024102.747052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789024102.747134:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422339328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789024102.747202:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789024102.747238:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747249:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747255:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747261:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024102.747265:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747290:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747309:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:1.0:1789024102.747312:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789024102.747318:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.747324:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3e38 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789024102.747419:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789024102.747470:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789024102.747480:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420783333259ns, next at 421783330942ns, rc = 0 00000001:00080000:1.0:1789024102.747486:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1789024102.747507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cb02319000) 00010000:00010000:1.0:1789024102.747510:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789024102.747517:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3e23 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5c7 expref: 50 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024102.747622:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+49:11374:x1875927402341888:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 24691us (24931us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789024102.747631:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000020:00080000:1.0:1789024102.747635:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789024102.751435:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024102.751561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342144 00000100:00100000:1.0:1789024102.751572:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342144 00000100:00100000:1.0:1789024102.751634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 111 00000100:00100000:1.0:1789024102.751645:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+49:11374:x1875927402342144:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024102.751690:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024102.751720:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3e3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.751785:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3e3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ce expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.751801:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3e3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ce expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024102.751832:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024102.751835:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024102.751839:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54600, rc 0) 00000100:00100000:1.0:1789024102.751891:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+50:11374:x1875927402342144:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 248us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.751898:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 111 00000100:00100000:0.0:1789024102.761725:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.761853:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342400 00000100:00100000:2.0:1789024102.761879:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342400 00000100:00100000:2.0:1789024102.761943:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:2.0:1789024102.761953:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+50:11374:x1875927402342400:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024102.762239:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+51:11374:x1875927402342400:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 287us (523us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789024102.762254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:3.0:1789024102.798665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422339456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024102.798744:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024102.798929:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422339456 00000100:00100000:1.0:1789024102.798940:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422339456 00000100:00100000:1.0:1789024102.798990:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789024102.798999:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422339456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024102.799042:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024102.799099:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422339456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024102.799105:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789024102.799246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422339456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024102.884218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.884263:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342528 00000100:00100000:0.0:1789024102.884274:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342528 00000100:00100000:0.0:1789024102.884348:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 112 00000100:00100000:0.0:1789024102.884359:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+51:11384:x1875927402342528:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:0.0:1789024102.884441:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884457:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884470:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884502:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884509:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884515:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884591:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884600:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884606:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024102.884661:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884675:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884684:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884691:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884699:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.884703:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884719:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884733:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:0.0:1789024102.884737:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.884743:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884749:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb3e46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884763:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884769:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884774:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884779:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ea00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.884781:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884787:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884793:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:0.0:1789024102.884796:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.884799:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884851:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb3e4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884863:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884869:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884875:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884880:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024102.884884:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884890:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884898:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024102.884900:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024102.884902:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024102.884909:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb3e54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024102.884999:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+51:11384:x1875927402342528:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 641us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024102.885008:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 112 00000100:00100000:0.0:1789024102.936669:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.936772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342784 00000100:00100000:2.0:1789024102.936782:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342784 00000100:00100000:2.0:1789024102.936855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 113 00000100:00100000:2.0:1789024102.936866:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+51:11387:x1875927402342784:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024102.936887:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024102.936907:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3e5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.936976:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.936991:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937003:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937015:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937023:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937029:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937180:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3e70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937190:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937197:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024102.937206:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789024102.937283:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937291:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937297:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937303:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024102.937308:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937330:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937342:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024102.937345:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024102.937350:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937376:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3e62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937391:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937396:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937402:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937406:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024102.937410:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937415:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937423:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:2.0:1789024102.937426:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024102.937428:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937433:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb3e69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937479:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3e5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5d5 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937492:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5d5 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024102.937503:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:2.0:1789024102.937506:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024102.937508:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:2.0:1789024102.937573:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11387:x1875927402342784:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 708us (915us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789024102.937580:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 113 00000100:00100000:3.0:1789024102.945968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024102.946080:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402342912 00000100:00100000:0.0:1789024102.946091:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402342912 00000100:00100000:3.0:1789024102.946251:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 114 00000100:00100000:3.0:1789024102.946264:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11387:x1875927402342912:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:3.0:1789024102.946344:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946361:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946388:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946434:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946442:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946452:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946458:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024102.946463:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946472:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946483:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024102.946503:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789024102.946511:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024102.946517:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024102.946624:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11387:x1875927402342912:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 362us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024102.946632:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 114 00000100:00100000:3.0:1789024102.949748:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024102.949863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402343168 00000100:00100000:2.0:1789024102.949875:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402343168 00000100:00100000:2.0:1789024102.949940:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:2.0:1789024102.949951:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+53:11387:x1875927402343168:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024102.950417:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11387:x1875927402343168:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 465us (677us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789024102.950426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:1.0:1789024103.067963:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024103.068203:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402343424 00000100:00100000:3.0:1789024103.068213:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402343424 00000100:00100000:3.0:1789024103.068285:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00100000:3.0:1789024103.068295:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11397:x1875927402343424:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024103.068326:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024103.068330:0:7824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789024103.068363:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3e00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5b9 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068384:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024103.068390:0:7824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024103.068405:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3e85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5dc expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068536:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068562:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068588:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024103.068599:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789024103.068711:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3e85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5dc expref: 56 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068726:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5dc expref: 55 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.068734:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024103.068736:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024103.068739:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00100000:3.0:1789024103.068826:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+55:11397:x1875927402343424:12345-192.168.202.18@tcp:101:bash.0 Request processed in 532us (876us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789024103.068834:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00080000:0.0:1789024103.069999:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024103.078325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024103.078429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024103.078818:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402343680 00000100:00100000:2.0:1789024103.078831:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402343680 00000100:00100000:2.0:1789024103.078910:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:2.0:1789024103.078922:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+55:2403:x1875927402343680:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024103.078960:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024103.078993:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3e8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5dc expref: 55 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024103.079019:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:2.0:1789024103.079026:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024103.079115:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+54:2403:x1875927402343680:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 194us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024103.079140:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:1.0:1789024103.081621:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402343552 00000100:00100000:1.0:1789024103.081643:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402343552 00000100:00100000:1.0:1789024103.082117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00100000:1.0:1789024103.082131:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+54:11397:x1875927402343552:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024103.082187:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024103.082211:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3e9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082259:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082275:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082289:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082700:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3e9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 56 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082720:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.082729:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.082732:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024103.082736:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54000, rc 0) 00000100:00100000:1.0:1789024103.082864:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+55:11397:x1875927402343552:12345-192.168.202.18@tcp:101:bash.0 Request processed in 735us (4562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.082872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00100000:0.0:1789024103.086510:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.086675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402343936 00000100:00100000:1.0:1789024103.086688:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402343936 00000100:00100000:1.0:1789024103.086824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 117 00000100:00100000:1.0:1789024103.086835:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+55:11397:x1875927402343936:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:1.0:1789024103.086892:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024103.086919:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3e70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5d5 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.086940:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.086945:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024103.087466:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.087485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.087497:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024103.087569:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1789024103.087596:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062bbad65 reply state 00000000e17b2ee8 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.087608:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.087615:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.087618:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024103.087621:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024103.087731:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+57:11397:x1875927402343936:12345-192.168.202.18@tcp:36:bash.0 Request processed in 896us (1230us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789024103.087739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 117 00000020:00080000:1.0:1789024103.087757:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789024103.092868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024103.093058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344064 00000100:00100000:0.0:1789024103.093073:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344064 00000100:00100000:3.0:1789024103.093330:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 118 00000100:00100000:3.0:1789024103.093343:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+57:11397:x1875927402344064:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024103.093374:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024103.093400:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3eaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5ea expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.093514:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.093932:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.093948:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024103.093991:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789024103.093996:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024103.094019:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.094054:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3eaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 59 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.094074:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 58 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.094094:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024103.094098:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024103.094104:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:3.0:1789024103.094291:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11397:x1875927402344064:12345-192.168.202.18@tcp:101:bash.0 Request processed in 950us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024103.094301:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 118 00000100:00100000:0.0:1789024103.102826:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.103073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344320 00000100:00100000:1.0:1789024103.103095:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344320 00000100:00100000:2.0:1789024103.103419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:2.0:1789024103.103432:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+58:11397:x1875927402344320:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:2.0:1789024103.104070:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11397:x1875927402344320:12345-192.168.202.18@tcp:35:bash.0 Request processed in 637us (1277us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789024103.104079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:0.0:1789024103.177834:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.178656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344448 00000100:00100000:1.0:1789024103.178673:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344448 00000100:00100000:1.0:1789024103.178824:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 119 00000100:00100000:1.0:1789024103.178836:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+59:11403:x1875927402344448:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024103.178864:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024103.178887:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.178962:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.178981:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.178994:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024103.179054:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789024103.179059:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024103.179093:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.179121:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54e00/0xa736ef4b98cb3ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f1 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.179139:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f1 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.179487:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024103.179490:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789024103.179495:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb03a54200, rc 0) 00000100:00100000:1.0:1789024103.179582:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402344448:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 747us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.179590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 119 00000100:00100000:2.0:1789024103.186591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.186700:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344576 00000100:00100000:1.0:1789024103.186714:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344576 00000100:00100000:1.0:1789024103.186906:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 120 00000100:00100000:1.0:1789024103.186917:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402344576:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024103.186945:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024103.186971:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3ecb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187065:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187096:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187110:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187124:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187131:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187188:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187287:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187296:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187303:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024103.187506:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789024103.187511:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024103.187537:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187550:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187560:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187566:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187573:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187579:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024103.187583:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187597:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187610:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024103.187613:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024103.187618:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187625:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54c00/0xa736ef4b98cb3ed2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187640:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187647:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187653:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187658:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024103.187660:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187666:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187672:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:1.0:1789024103.187675:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024103.187679:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187697:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55600/0xa736ef4b98cb3ed9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55200/0xa736ef4b98cb3ecb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187740:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.187748:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.187751:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024103.187754:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323a00, rc 0) 00000100:00100000:1.0:1789024103.188001:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11403:x1875927402344576:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1085us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.188010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 120 00000100:00100000:0.0:1789024103.191842:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024103.192004:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344832 00000100:00100000:3.0:1789024103.192016:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344832 00000100:00100000:3.0:1789024103.192085:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 121 00000100:00100000:3.0:1789024103.192095:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11403:x1875927402344832:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024103.192116:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024103.192195:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ee7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af5ff expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192321:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192337:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192345:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192355:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192389:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192404:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024103.192420:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422339584:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024103.192422:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00010000:00010000:3.0:1789024103.192601:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.192611:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024103.192620:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422339712:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024103.192707:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402344960 00000100:00100000:1.0:1789024103.192714:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402344960 00010000:00010000:1.0:1789024103.192738:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 63 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024103.192772:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:1.0:1789024103.192780:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+63:2401:x1875927402344960:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024103.192870:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024103.192878:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 63 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.192900:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 63 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.192917:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.192922:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.192930:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.192936:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024103.195395:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+63:2401:x1875927402344960:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 2602us (2964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.195411:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:3.0:1789024103.198790:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7000 going to sleep for 11 seconds 00010000:00010000:3.0:1789024103.200062:0:13818:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.18@tcp) returned -22 from blocking AST (req@00000000085371c3 x1875927422339584) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024103.200086:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3ee0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f8 expref: 62 pid: 6515 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024103.200107:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422339584:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024103.201934:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422339712:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024103.201972:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024103.201980:0:13818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.201994:0:13818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.202004:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024103.202690:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.202750:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345088 00000100:00100000:1.0:1789024103.202760:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345088 00010000:00010000:1.0:1789024103.202819:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024103.202957:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:1.0:1789024103.202971:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+62:2401:x1875927402345088:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024103.202991:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024103.203001:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203191:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203234:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3eb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ea expref: 62 pid: 13818 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203254:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.203259:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203270:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203277:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.203299:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024103.203424:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.203433:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024103.203453:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789024103.203604:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb3ee7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 63 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.203632:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 62 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.203639:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024103.203642:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789024103.203645:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5400, rc 0) 00000100:00100000:0.0:1789024103.203728:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11403:x1875927402344832:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 11634us (11898us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789024103.203736:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 121 00000100:00100000:1.0:1789024103.203828:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+61:2401:x1875927402345088:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 860us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.203836:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:3.0:1789024103.212059:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024103.212254:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345344 00000100:00100000:0.0:1789024103.212267:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345344 00000100:00100000:0.0:1789024103.212342:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:0.0:1789024103.212354:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11403:x1875927402345344:12345-192.168.202.18@tcp:103:lfs.0 00010000:00010000:0.0:1789024103.212370:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024103.212397:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54600/0xa736ef4b98cb3e3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ce expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024103.212416:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024103.212421:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024103.212488:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402345344:12345-192.168.202.18@tcp:103:lfs.0 Request processed in 135us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024103.212496:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:2.0:1789024103.218304:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.218408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345472 00000100:00100000:1.0:1789024103.218423:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345472 00000100:00100000:1.0:1789024103.218538:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 122 00000100:00100000:1.0:1789024103.218550:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402345472:12345-192.168.202.18@tcp:58:lfs.0 00010000:00010000:1.0:1789024103.218668:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.218688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.218701:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024103.218867:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789024103.218956:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402345472:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 408us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.218964:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 122 00000100:00100000:2.0:1789024103.223266:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024103.223343:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345600 00000100:00100000:1.0:1789024103.223354:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345600 00000100:00100000:1.0:1789024103.223425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 123 00000100:00100000:1.0:1789024103.223436:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+60:11403:x1875927402345600:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024103.223456:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024103.223477:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af606 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223540:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223552:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223571:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223586:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223600:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024103.223603:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024103.223607:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024103.223630:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322e00, rc 0) 00000100:00100000:1.0:1789024103.223691:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11403:x1875927402345600:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 258us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024103.223698:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 123 00010000:00010000:2.0:1789024103.308469:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024103.822109:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024103.822134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422339840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024103.822237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024103.822743:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422339840 00000100:00100000:2.0:1789024103.822753:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422339840 00000100:00100000:2.0:1789024103.822836:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789024103.822848:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422339840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024103.822890:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024103.822948:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422339840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024103.822955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789024103.823016:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422339840:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1789024103.823335:0:8902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421859187043ns, next at 422859184607ns, rc = 0 00000100:00100000:0.0:1789024103.823509:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024103.823522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422339968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024103.823588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024103.825775:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422339968 00000100:00100000:3.0:1789024103.825790:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422339968 00000100:00100000:3.0:1789024103.825885:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789024103.825895:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422339968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024103.825920:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024103.826009:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422339968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024103.826016:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789024103.826137:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422339968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789024103.826768:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789024104.013902:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024104.013922:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024104.013972:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789024104.013985:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789024104.014182:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422340096:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024104.015040:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908480 going to sleep for 11 seconds 00000100:00100000:2.0:1789024104.036362:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.036476:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422340096:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789024104.036837:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345728 00000100:00100000:0.0:1789024104.036845:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345728 00000100:00100000:0.0:1789024104.036911:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00100000:0.0:1789024104.036922:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11404:x1875927402345728:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789024104.036955:0:13818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789024104.037142:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11404:x1875927402345728:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 221us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.037188:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00100000:3.0:1789024104.044891:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.045025:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402345856 00000100:00100000:1.0:1789024104.045035:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402345856 00000100:00100000:1.0:1789024104.045211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:1.0:1789024104.045224:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11404:x1875927402345856:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.045311:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045330:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045345:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045382:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045390:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045397:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045423:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045445:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045452:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024104.045503:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789024104.045508:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024104.045539:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045552:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045558:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045565:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045582:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024104.045587:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045595:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045608:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:1.0:1789024104.045612:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024104.045617:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045623:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3f0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045649:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045655:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045662:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045667:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024104.045670:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045676:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045695:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff90cc33aa9e00) 00010000:00010000:1.0:1789024104.045697:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024104.045700:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045706:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045729:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045735:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045740:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.045746:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024104.046099:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.046109:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.046119:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024104.046121:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024104.046125:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.046131:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.046312:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11404:x1875927402345856:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 Request processed in 1089us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.046321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:3.0:1789024104.050786:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.051066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402346112 00000100:00100000:1.0:1789024104.051077:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402346112 00000100:00100000:1.0:1789024104.051190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:1.0:1789024104.051202:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+61:11404:x1875927402346112:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.051223:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.051245:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb3f1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af60d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051358:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051374:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051386:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024104.051398:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789024104.051675:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051684:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051690:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051714:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024104.051719:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051728:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051740:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024104.051743:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789024104.051950:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.051959:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.052013:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb3f1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af60d expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.052023:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:1.0:1789024104.052026:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024104.052030:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb3f1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af60d expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.052040:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323400, rc 0) 00000100:00100000:1.0:1789024104.052199:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346112:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 998us (1424us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789024104.052208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:2.0:1789024104.067314:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.074712:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402346240 00000100:00100000:0.0:1789024104.074727:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402346240 00000100:00100000:0.0:1789024104.074853:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 127 00000100:00100000:0.0:1789024104.074865:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346240:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789024104.074901:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789024104.075029:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346240:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 167us (7726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.075036:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 127 00000100:00100000:3.0:1789024104.095225:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.095851:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402346496 00000100:00100000:1.0:1789024104.095877:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402346496 00000100:00100000:1.0:1789024104.095941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 128 00000100:00100000:1.0:1789024104.095951:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346496:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.095970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.095973:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789024104.095999:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54200/0xa736ef4b98cb3ec4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5f1 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.096017:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:1.0:1789024104.096021:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024104.096034:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb3f34 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af614 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789024104.096614:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789024104.096957:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.096973:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.096983:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.097039:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb3f34 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af614 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.097056:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af614 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.097080:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9e00) 00010000:00010000:1.0:1789024104.097082:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024104.097085:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322400, rc 0) 00000100:00100000:1.0:1789024104.097205:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+63:11404:x1875927402346496:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1254us (1991us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789024104.097214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 128 00000100:00100000:2.0:1789024104.114840:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.115009:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402346752 00000100:00100000:3.0:1789024104.115019:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402346752 00000100:00100000:3.0:1789024104.115082:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 129 00000100:00100000:3.0:1789024104.115093:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+63:11404:x1875927402346752:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789024104.115205:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024104.115241:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb3f3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af614 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115262:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9e00) 00010000:00010000:3.0:1789024104.115282:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024104.115303:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115318:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115454:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115474:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115482:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115489:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115534:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115542:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115550:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115557:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.115568:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115576:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115586:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024104.115589:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024104.115593:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115600:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb3f49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115610:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115617:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115624:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115870:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.115874:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115880:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115890:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x12beab89 (ffff90cb02319400) 00010000:00010000:3.0:1789024104.115892:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024104.115902:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.115908:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f50 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x12beab89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.116616:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346752:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 1520us (1785us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789024104.116626:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 129 00000100:00100000:3.0:1789024104.133310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.133575:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402346880 00000100:00100000:1.0:1789024104.133588:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402346880 00000100:00100000:1.0:1789024104.133665:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 130 00000100:00100000:1.0:1789024104.133677:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+62:11404:x1875927402346880:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.133700:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.133725:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af61b expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133765:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133778:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133789:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133917:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3f57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 64 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133936:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 63 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.133952:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:1.0:1789024104.133956:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024104.133960:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322200, rc 0) 00000100:00100000:1.0:1789024104.134024:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+63:11404:x1875927402346880:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 349us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.134031:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 130 00000100:00100000:1.0:1789024104.144613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.145076:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402347136 00000100:00100000:0.0:1789024104.145087:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402347136 00000100:00100000:0.0:1789024104.145192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 131 00000100:00100000:0.0:1789024104.145204:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+63:11404:x1875927402347136:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789024104.145306:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.145341:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.145373:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024104.145539:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1789024104.145593:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e782fc39 reply state 00000000c9043c4c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.145606:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.145615:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:0.0:1789024104.145618:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789024104.145635:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789024104.146130:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:11404:x1875927402347136:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 926us (1524us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789024104.146138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 131 00000100:00100000:2.0:1789024104.157047:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.158234:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402347264 00000100:00100000:3.0:1789024104.158248:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402347264 00000100:00100000:3.0:1789024104.158344:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 132 00000100:00100000:3.0:1789024104.158355:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+65:11404:x1875927402347264:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024104.158381:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024104.158414:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af622 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.158481:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 66 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.158496:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 66 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.158514:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:3.0:1789024104.158518:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024104.158523:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:3.0:1789024104.158596:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+66:11404:x1875927402347264:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 243us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.158620:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 132 00000100:00100000:3.0:1789024104.163061:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.164089:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402347392 00000100:00100000:0.0:1789024104.164104:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402347392 00000100:00080000:1.0:1789024104.164208:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024104.164558:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:2.0:1789024104.164572:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2401:x1875927402347392:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789024104.165628:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2401:x1875927402347392:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 1053us (2573us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789024104.165639:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:1.0:1789024104.182448:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.182570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402347648 00000100:00100000:0.0:1789024104.182581:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402347648 00000100:00100000:0.0:1789024104.182649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:0.0:1789024104.182659:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:11404:x1875927402347648:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789024104.182960:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+67:11404:x1875927402347648:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 302us (523us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789024104.182967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:0.0:1789024104.197839:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.197949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402347904 00000100:00100000:1.0:1789024104.197961:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402347904 00000100:00100000:1.0:1789024104.198068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 133 00000100:00100000:1.0:1789024104.198081:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+67:11404:x1875927402347904:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789024104.198294:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+67:11404:x1875927402347904:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 215us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.198302:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 133 00000100:00100000:3.0:1789024104.204773:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.204910:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348032 00000100:00100000:2.0:1789024104.204918:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348032 00000100:00100000:2.0:1789024104.204974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 134 00000100:00100000:2.0:1789024104.204981:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+67:11404:x1875927402348032:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024104.204998:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024104.205015:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3f73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af629 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205076:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205087:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205095:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024104.205142:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024104.205188:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205210:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3f73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af629 expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205242:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af629 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.205248:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:2.0:1789024104.205251:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789024104.205254:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5600, rc 0) 00000100:00100000:2.0:1789024104.205314:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+68:11404:x1875927402348032:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 334us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.205319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 134 00000100:00100000:3.0:1789024104.212894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.213026:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348160 00000100:00100000:1.0:1789024104.213036:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348160 00000100:00100000:1.0:1789024104.213089:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:1.0:1789024104.213104:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402348160:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.213122:0:10202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.213141:0:10202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af630 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024104.213339:0:10202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa25768, blocks: 0x0 00010000:00010000:1.0:1789024104.213384:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:1.0:1789024104.213389:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024104.213400:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 10 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.213421:0:10202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 10 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.213435:0:10202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323000, rc 0) 00000100:00100000:1.0:1789024104.213496:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402348160:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 398us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.213502:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:0.0:1789024104.223574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.223905:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348416 00000100:00100000:3.0:1789024104.223914:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348416 00000100:00100000:3.0:1789024104.223980:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 135 00000100:00100000:3.0:1789024104.223992:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+68:11404:x1875927402348416:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789024104.224128:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+68:11404:x1875927402348416:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 138us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.224136:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 135 00000100:00100000:0.0:1789024104.231134:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.231545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348544 00000100:00100000:1.0:1789024104.231558:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348544 00000100:00100000:1.0:1789024104.231629:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:1.0:1789024104.231640:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+10:11404:x1875927402348544:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024104.231660:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.231681:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af637 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.231720:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 11 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.231730:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024104.231735:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024104.231741:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.231783:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 11 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.231809:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 11 pid: 10202 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.231823:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875927422340224:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024104.231921:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908180 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.238862:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.239097:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348672 00000100:00100000:2.0:1789024104.239123:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348672 00010000:00010000:2.0:1789024104.239229:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 12 pid: 10202 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.239290:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:2.0:1789024104.239302:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2403:x1875927402348672:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024104.239361:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024104.239389:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 12 pid: 10202 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.239405:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 12 pid: 10202 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.239433:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024104.239444:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024104.239454:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.239464:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.239503:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.239518:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875927422340352:192.168.202.18@tcp:105: 00000100:00100000:2.0:1789024104.239601:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc055143c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789024104.240567:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff1a958/0xa736ef4b98cb3f81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af630 expref: 12 pid: 10202 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.240592:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb039e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875927422340224:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024104.240616:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.240627:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323c00, rc 0) 00000100:00100000:0.0:1789024104.240677:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:11404:x1875927402348544:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 9029us (9545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.240686:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:2.0:1789024104.246222:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875927422340352:192.168.202.18@tcp:105: 00010000:00010000:2.0:1789024104.246251:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024104.246714:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2403:x1875927402348672:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 7412us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.246726:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:1.0:1789024104.264546:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.264716:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348800 00000100:00100000:0.0:1789024104.264726:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348800 00002000:00100000:0.0:1789024104.264773:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90cb039e8700 x1875927402348800/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:275/0 lens 504/0 e 0 to 0 dl 1789024115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789024104.264785:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb039e8700 with x1875927402348800 ext(0->12) 00002000:00010000:0.0:1789024104.264791:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cb039e8700 00000100:00100000:0.0:1789024104.264830:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:0.0:1789024104.264840:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402348800:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789024104.269956:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2402:x1875927402348800:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 Request processed in 5107us (5410us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789024104.269970:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00002000:00100000:2.0:1789024104.269986:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90cb039e8700 x1875927402348800/t4294967309(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:275/0 lens 504/448 e 0 to 0 dl 1789024115 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024104.269997:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb039e8700 with x1875927402348800 ext(0->12) 00002000:00010000:2.0:1789024104.270004:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cb039e8700 00000100:00100000:0.0:1789024104.273636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.274209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402348928 00000100:00100000:1.0:1789024104.274220:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402348928 00000100:00100000:1.0:1789024104.274284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 136 00000100:00100000:1.0:1789024104.274292:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:11404:x1875927402348928:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789024104.285456:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789024104.285573:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789024104.285624:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789024104.285658:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cb024d5f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789024104.285665:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc346c9400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cb024d56c0 00000020:00080000:2.0:1789024104.285669:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc346c9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cb03ad0e00 00000100:00100000:1.0:1789024104.285786:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024104.285820:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422340480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789024104.285896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789024104.286213:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789024104.286220:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024104.286229:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422340608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789024104.286261:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024104.286300:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422340480 00000100:00100000:3.0:1789024104.286308:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422340480 00000100:00100000:3.0:1789024104.286349:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422340608 00000100:00100000:3.0:1789024104.286353:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422340608 00000100:00100000:3.0:1789024104.286453:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789024104.286461:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422340480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789024104.286490:0:10202:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1789024104.286516:0:10202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286539:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286557:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789024104.286562:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024104.286567:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286598:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286612:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 11 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.286624:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422340736:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024104.286686:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7000 going to sleep for 11 seconds 00000100:00080000:3.0:1789024104.286699:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024104.286711:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789024104.286717:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422340608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789024104.286728:0:8904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1789024104.286748:0:8904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa25767, atime: 0x6aa25767, ctime: 0x6aa25767, blocks: 0x8 00010000:00010000:3.0:1789024104.286752:0:8904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286759:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1789024104.286761:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024104.286766:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286783:0:8904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286790:0:8904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286808:0:8904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.286825:0:8904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789024104.286983:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875927422340608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 266us (721us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789024104.286989:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789024104.287007:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024104.287011:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.287017:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024104.287020:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.287027:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.287039:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.287048:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b285fce5/0xa736ef4b98cb3f96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.287062:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024104.287063:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024104.287064:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789024104.287087:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cc3fae0a80/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789024104.287091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422340608:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789024104.289789:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789024104.289877:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cc05514540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789024104.289885:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cb025e9300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cc05514f00 00000020:00080000:2.0:1789024104.289889:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cb025e9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cb03336600 00010000:00010000:0.0:1789024104.290222:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290239:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290280:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290289:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.290296:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290306:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789024104.290324:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:0.0:1789024104.290332:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90cc2d0d4800) 00010000:00010000:0.0:1789024104.290339:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024104.290347:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290355:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55c00/0xa736ef4b98cb3c8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290400:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290407:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290412:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290418:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.290422:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290440:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789024104.290449:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789024104.290453:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90cc351fff00) 00010000:00010000:0.0:1789024104.290459:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024104.290464:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290471:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3d35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290500:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290508:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290529:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290536:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.290539:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290546:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290555:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:0.0:1789024104.290558:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024104.290561:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290575:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55800/0xa736ef4b98cb3db3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290589:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290595:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290602:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290608:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.290611:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290618:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290626:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9400) 00010000:00010000:0.0:1789024104.290628:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024104.290631:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290638:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb3dd6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290665:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.290671:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.291315:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+18:11404:x1875927402348928:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 Request processed in 17012us (17675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.291331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 136 00010000:00010000:0.0:1789024104.292098:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292375:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.292386:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292400:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292422:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024104.292426:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024104.292430:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292438:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55400/0xa736ef4b98cb3ea8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292461:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292469:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292476:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292482:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.292485:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292524:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292534:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:0.0:1789024104.292536:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789024104.292540:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.292546:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb3f65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.300519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.300661:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349056 00000100:00100000:2.0:1789024104.300674:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349056 00010000:00010000:2.0:1789024104.300741:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 12 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.300839:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 73 00000100:00100000:2.0:1789024104.300851:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2403:x1875927402349056:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024104.300872:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024104.300879:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 12 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.300897:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 12 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.300930:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024104.300936:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024104.300963:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.300975:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.301003:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024104.301072:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f195450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2403:x1875927402349056:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 222us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.301080:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 73 00010000:00010000:3.0:1789024104.301676:0:10202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7ef61d8/0xa736ef4b98cb3d43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af58f expref: 11 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.301708:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422340736:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024104.301745:0:10202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.301759:0:10202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.301766:0:10202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.301777:0:10202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.301814:0:10202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.301851:0:10202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789024104.302134:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422340480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15672us (16236us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789024104.302144:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:3.0:1789024104.302257:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cc07484700/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789024104.302271:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422340480:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789024104.302386:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024104.302396:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.302421:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024104.302427:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.302437:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.302461:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.302468:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955acb3d/0xa736ef4b98cb3f8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.302490:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024104.302492:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024104.302494:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024104.309404:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.309924:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349184 00000100:00100000:1.0:1789024104.309941:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349184 00000100:00100000:1.0:1789024104.310004:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:1.0:1789024104.310015:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2401:x1875927402349184:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789024104.315378:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789024104.315395:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789024104.321838:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402349184:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 Request processed in 11809us (12433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.321853:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:3.0:1789024104.332642:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422340864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024104.340307:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422341120:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340467:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422341632:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340503:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422342144:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340548:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789024104.340555:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422340992:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340585:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422341504:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422342016:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340665:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.340687:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422340992 00000100:00100000:2.0:1789024104.340694:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422340992 00000100:00100000:2.0:1789024104.340730:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789024104.340749:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422340992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340791:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422340992:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.340810:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789024104.340845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341504 00000100:00100000:2.0:1789024104.340849:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341504 00000100:00100000:2.0:1789024104.340874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789024104.340880:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.340914:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422341504:12345-0@lo:400:kworker.0 Request processed in 34us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.340920:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789024104.340946:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341120 00000100:00100000:2.0:1789024104.340950:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341120 00000100:00100000:2.0:1789024104.340983:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341632 00000100:00100000:2.0:1789024104.340987:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341632 00000100:00100000:2.0:1789024104.341012:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422342144 00000100:00100000:2.0:1789024104.341015:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422342144 00000100:00100000:2.0:1789024104.341028:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422342016 00000100:00100000:2.0:1789024104.341030:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422342016 00000100:00100000:2.0:1789024104.341045:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789024104.341050:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341084:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422341120:12345-0@lo:400:kworker.0 Request processed in 34us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.341091:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789024104.341103:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789024104.341109:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341134:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422341632:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.341180:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789024104.341196:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789024104.341202:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422342144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341232:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422342144:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.341238:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789024104.341250:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789024104.341257:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422342016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341282:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422342016:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.341288:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1789024104.341323:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422340992:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341335:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422341504:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341343:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422342016:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341352:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422341120:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.341361:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422341632:0@lo:400:kworker.0 00010000:00080000:2.0:1789024104.341373:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae0000 x1875927422342144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024104.341382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422342144:0@lo:400:kworker.0 00000100:00080000:2.0:1789024104.341436:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024104.341441:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024104.341921:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422341248:0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.341950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024104.341969:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422341760:0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.341989:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024104.342008:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422342272:0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.342032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024104.342055:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024104.342061:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422342400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024104.342084:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024104.342116:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341760 00000100:00100000:0.0:1789024104.342120:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341760 00000100:00100000:0.0:1789024104.342178:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789024104.342195:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422341760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.342236:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422341760:12345-0@lo:400:kworker.0 Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.342242:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:0.0:1789024104.342260:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789024104.342279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae3800 x1875927422341760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024104.342290:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422341760:0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.342375:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341248 00000100:00100000:2.0:1789024104.342389:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341248 00000100:00100000:2.0:1789024104.342427:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789024104.342434:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.342470:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422341248:12345-0@lo:400:kworker.0 Request processed in 37us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.342476:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789024104.342545:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422341248:0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.343075:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422342400 00000100:00100000:0.0:1789024104.343082:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422342400 00000100:00100000:0.0:1789024104.343117:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789024104.343122:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422342400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789024104.343160:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789024104.343217:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422342400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.343224:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789024104.343264:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc012ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422342400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024104.343440:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422342272 00000100:00100000:2.0:1789024104.343445:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422342272 00000100:00100000:2.0:1789024104.343494:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789024104.343501:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422342272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024104.343539:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422342272:12345-0@lo:400:kworker.0 Request processed in 38us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.343545:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789024104.343629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.343708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349440 00000100:00100000:2.0:1789024104.343712:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349440 00000100:00100000:2.0:1789024104.343749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 137 00000100:00100000:2.0:1789024104.343757:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11404:x1875927402349440:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789024104.343806:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024104.343832:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3f7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af629 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.343851:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:2.0:1789024104.343856:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789024104.343885:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.343900:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.343918:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024104.344046:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2d8c5da reply state 00000000c25dd35b transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.344056:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.344060:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:2.0:1789024104.344063:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024104.344065:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789024104.344138:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11404:x1875927402349440:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 383us (513us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789024104.344142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 137 00000100:00080000:0.0:1789024104.344353:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024104.344376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422342272:0@lo:400:kworker.0 00000100:00100000:3.0:1789024104.345662:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024104.345714:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422341376:0@lo:400:kworker.0 00000100:00100000:3.0:1789024104.345750:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024104.345780:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422341888:0@lo:400:kworker.0 00000100:00100000:3.0:1789024104.345816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024104.345890:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024104.345962:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341888 00000100:00100000:1.0:1789024104.345970:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341888 00000100:00100000:1.0:1789024104.346016:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789024104.346021:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422341888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024104.346058:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422341888:12345-0@lo:400:kworker.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.346062:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789024104.346128:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422341376 00000100:00100000:0.0:1789024104.346131:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422341376 00000100:00100000:0.0:1789024104.346185:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789024104.346190:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024104.346222:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422341376:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.346235:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789024104.346500:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422341376:0@lo:400:kworker.0 00000100:00100000:3.0:1789024104.346507:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422341888:0@lo:400:kworker.0 00000100:00100000:1.0:1789024104.346821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.346889:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349568 00000100:00100000:0.0:1789024104.346894:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349568 00000100:00100000:0.0:1789024104.346925:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:0.0:1789024104.346930:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402349568:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789024104.347073:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789024104.347077:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789024103 00002000:00010000:0.0:1789024104.347079:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789024103 00002000:00010000:0.0:1789024104.347081:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789024104 -> 1789024103 00002000:00010000:0.0:1789024104.347084:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789024104.347462:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402349568:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 212us (323us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789024104.347472:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:2.0:1789024104.347666:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422340864 00000100:00100000:2.0:1789024104.347671:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422340864 00000100:00100000:2.0:1789024104.347713:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789024104.347722:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422340864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024104.347737:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789024104.347791:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422340864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.347807:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789024104.348013:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422340864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024104.352233:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.352380:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349824 00000100:00100000:2.0:1789024104.352393:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349824 00000100:00100000:2.0:1789024104.352512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 138 00000100:00100000:2.0:1789024104.352537:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+17:11404:x1875927402349824:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789024104.352652:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.352673:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 17 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.352683:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.352735:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 17 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.352752:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 17 pid: 7824 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.352768:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875927422342528:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024104.352868:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.370826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.370940:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875927422342528:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024104.370971:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.371804:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402349952 00000100:00100000:3.0:1789024104.371814:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402349952 00010000:00010000:2.0:1789024104.371977:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 18 pid: 7824 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.372016:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 74 00000100:00100000:2.0:1789024104.372026:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402349952:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024104.372043:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024104.372068:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 18 pid: 7824 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372078:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 18 pid: 7824 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372099:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb3f5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af61b expref: 18 pid: 7824 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372112:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:2.0:1789024104.372116:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372124:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372130:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.372191:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024104.372269:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+17:2402:x1875927402349952:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 244us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.372277:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 74 00010000:00010000:0.0:1789024104.372386:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372396:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372437:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372444:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372451:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372550:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024104.372555:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372563:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372572:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:0.0:1789024104.372640:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789024104.372647:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.372653:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fa4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.372702:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11404:x1875927402349824:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 Request processed in 20180us (20484us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789024104.372711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 138 00000100:00100000:2.0:1789024104.379547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.379671:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350080 00000100:00100000:3.0:1789024104.379682:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350080 00000100:00100000:3.0:1789024104.379783:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:3.0:1789024104.379812:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402350080:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789024104.379879:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.379902:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.379910:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024104.379915:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024104.379920:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.379956:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.379972:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 7 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.379987:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422342656:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024104.380082:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.389467:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.389500:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350208 00000100:00100000:1.0:1789024104.389509:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350208 00010000:00010000:1.0:1789024104.389552:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 8 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.389605:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 75 00000100:00100000:1.0:1789024104.389615:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402350208:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024104.389633:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024104.389657:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 8 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.389673:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 8 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.389702:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024104.389706:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024104.389713:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.389740:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.389764:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024104.389823:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402350208:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 209us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.389830:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 75 00010000:00010000:0.0:1789024104.390068:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb3f88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af637 expref: 7 pid: 8433 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.390085:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422342656:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024104.390106:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390116:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390136:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390184:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390199:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390208:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390215:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024104.390219:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390228:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390242:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.390249:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b285fce5/0xa736ef4b98cb3fab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.390308:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402350080:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 Request processed in 10515us (10769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.390316:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:1.0:1789024104.394260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.394516:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350464 00000100:00100000:2.0:1789024104.394527:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350464 00000100:00100000:2.0:1789024104.394609:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:2.0:1789024104.394621:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+16:11404:x1875927402350464:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789024104.394703:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.394734:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.394742:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.394775:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.394788:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 16 pid: 6517 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.394813:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422342784:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024104.394893:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.400030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.400116:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350592 00000100:00100000:3.0:1789024104.400127:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350592 00010000:00010000:3.0:1789024104.400220:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 17 pid: 6517 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.400258:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:3.0:1789024104.400268:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+17:2402:x1875927402350592:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024104.400302:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024104.400310:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 17 pid: 6517 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400324:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 17 pid: 6517 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400351:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024104.400357:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400368:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400376:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400383:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.400404:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024104.400467:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+17:2402:x1875927402350592:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 200us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.400474:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 76 00010000:00010000:2.0:1789024104.400792:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a54000/0xa736ef4b98cb3ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5e3 expref: 16 pid: 6517 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.400821:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422342784:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024104.400844:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.400853:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.400859:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.401043:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.401062:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 16 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.401072:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.401100:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 16 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.401115:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 16 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.401128:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422342912:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024104.401525:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514480 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.405111:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.405328:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350720 00000100:00100000:0.0:1789024104.405339:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350720 00010000:00010000:0.0:1789024104.405383:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 17 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.405429:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 77 00000100:00100000:0.0:1789024104.405438:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+17:2403:x1875927402350720:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024104.405454:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024104.405461:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 17 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.405473:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 17 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.405495:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:0.0:1789024104.405501:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.405510:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.405518:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.405554:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024104.405619:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+17:2403:x1875927402350720:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 182us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.405626:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 77 00010000:00010000:2.0:1789024104.413645:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb3f6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af622 expref: 16 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.413675:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422342912:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024104.413703:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.413728:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.413735:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024104.413860:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789024104.414018:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789024104.414055:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789024104.414183:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422343040:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789024104.414805:0:13818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024104.414957:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc093c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.415089:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422343040 00000100:00100000:1.0:1789024104.415097:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422343040 00000100:00100000:1.0:1789024104.415513:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789024104.415525:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422343040:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789024104.415642:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422343040:12345-0@lo:1000:mdt00_004.0 Request processed in 120us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.415649:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789024104.415724:0:13818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789024104.415731:0:13818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1789024104.415746:0:13818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cc07484700, transno 4294967310 00000100:00100000:3.0:1789024104.415767:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422343040:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1789024104.415929:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789024104.415997:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422343168:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789024104.416031:0:13818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024104.416483:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1042ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789024104.416650:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422343168 00000100:00100000:2.0:1789024104.416657:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422343168 00000100:00100000:2.0:1789024104.416687:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789024104.416694:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422343168:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789024104.416821:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:13818:x1875927422343168:12345-0@lo:1000:mdt00_004.0 Request processed in 127us (789us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789024104.416829:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789024104.417028:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422343168:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1789024104.417068:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417079:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417086:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417092:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.417096:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417103:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417118:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:3.0:1789024104.417120:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024104.417125:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417130:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb3fb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417189:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417211:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417217:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417223:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.417226:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417232:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417241:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024104.417244:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024104.417250:0:13818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417263:0:13818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417273:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.417302:0:13818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024104.417314:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422343296:192.168.202.18@tcp:105: 00000100:00100000:3.0:1789024104.417389:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc05514f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.424189:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.424756:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422343296:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024104.424786:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424810:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb3efc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424845:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424861:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424875:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424887:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424893:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424900:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424906:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.424910:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424918:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424952:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024104.424955:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024104.424961:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424966:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb3fc0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424976:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424982:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424987:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.424991:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024104.424994:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.425001:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.425008:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024104.425011:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024104.425014:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.425019:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb3fb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024104.425593:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402350848 00000100:00100000:0.0:1789024104.425602:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402350848 00000100:00100000:3.0:1789024104.425645:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11404:x1875927402350464:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 31023us (31394us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789024104.425650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:3.0:1789024104.425663:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:0.0:1789024104.425664:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+20:11403:x1875927402350848:12345-192.168.202.18@tcp:49:lfs.0 00000020:00080000:3.0:1789024104.425672:0:13818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789024104.425746:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11403:x1875927402350848:12345-192.168.202.18@tcp:49:lfs.0 Request processed in 86us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.425750:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 31 00000040:00080000:1.0:1789024104.426136:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024104.426141:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024104.426829:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789024104.426838:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789024104.430861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.430915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.431058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351104 00000100:00100000:0.0:1789024104.431069:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351104 00000100:00100000:0.0:1789024104.431121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 32 00000100:00100000:0.0:1789024104.431131:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:11404:x1875927402351104:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789024104.431403:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789024104.431435:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789024104.431470:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431488:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431500:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431509:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431527:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431533:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024104.431557:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789024104.431999:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11404:x1875927402351104:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 867us (1145us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789024104.432007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 32 00000020:00080000:0.0:1789024104.432012:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789024104.432455:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024104.432463:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.432472:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024104.432477:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.432488:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.432502:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:3.0:1789024104.432505:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789024104.432510:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.432516:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb3fc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024104.432529:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024104.432531:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024104.432532:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024104.432607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351360 00000100:00100000:1.0:1789024104.432614:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351360 00000100:00100000:1.0:1789024104.432668:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:1.0:1789024104.432676:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11403:x1875927402351360:12345-192.168.202.18@tcp:58:lfs.0 00000040:00080000:1.0:1789024104.433022:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789024104.433089:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11403:x1875927402351360:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 412us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.433096:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:2.0:1789024104.469390:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.469475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.469510:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.469545:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024104.469587:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024104.469703:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351744 00000100:00100000:3.0:1789024104.469713:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351744 00000100:00100000:3.0:1789024104.469802:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 90 00000100:00100000:3.0:1789024104.469812:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402351744:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024104.469898:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402351744:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 88us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.469906:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 90 00000100:00100000:3.0:1789024104.470029:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352000 00000100:00100000:3.0:1789024104.470034:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352000 00000100:00100000:3.0:1789024104.470069:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351616 00000100:00100000:3.0:1789024104.470072:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351616 00000100:00100000:3.0:1789024104.470090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351872 00000100:00100000:3.0:1789024104.470092:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351872 00000100:00100000:3.0:1789024104.470108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 308 00000100:00100000:3.0:1789024104.470114:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402352000:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024104.470179:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402352000:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 64us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.470442:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 308 00000100:00100000:3.0:1789024104.470457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 309 00000100:00100000:3.0:1789024104.470465:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402351616:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024104.470512:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402351616:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 48us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.470519:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 309 00000100:00100000:3.0:1789024104.470532:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 310 00000100:00100000:3.0:1789024104.470539:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402351872:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024104.470563:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402351872:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024104.470569:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 310 00000100:00080000:2.0:1789024104.475052:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024104.475064:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024104.475069:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024104.480996:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402351488 00000100:00100000:0.0:1789024104.481014:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402351488 00000100:00100000:0.0:1789024104.481094:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 386 00000100:00100000:0.0:1789024104.481105:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402351488:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024104.481231:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402351488:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 128us (11852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024104.481238:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 386 00000100:00100000:2.0:1789024104.484739:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.484936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352128 00000100:00100000:1.0:1789024104.484946:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352128 00000100:00100000:1.0:1789024104.485010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 141 00000100:00100000:1.0:1789024104.485019:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:11406:x1875927402352128:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024104.485044:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024104.485063:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3fce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af63e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485125:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485140:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485187:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485211:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485220:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485227:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485319:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485331:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 22 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485340:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485372:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 22 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.485387:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 22 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.485412:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422343424:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024104.485489:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908900 going to sleep for 11 seconds 00000100:00100000:1.0:1789024104.492083:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422343424:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024104.492118:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024104.496954:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024104.498547:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352384 00000100:00100000:0.0:1789024104.498561:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352384 00000100:00100000:0.0:1789024104.498655:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:0.0:1789024104.498667:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+23:6172:x1875927402352384:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789024104.499062:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+24:6172:x1875927402352384:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 397us (2117us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789024104.499070:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:3.0:1789024104.501621:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024104.502261:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352512 00000100:00100000:1.0:1789024104.502273:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352512 00010000:00010000:1.0:1789024104.502317:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 24 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.502364:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 78 00000100:00100000:1.0:1789024104.502383:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+24:2403:x1875927402352512:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024104.502402:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024104.502411:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 24 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502425:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 24 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502451:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb3eee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af5ff expref: 24 pid: 13818 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502470:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024104.502476:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502486:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502496:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024104.502537:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789024104.502593:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502607:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024104.502607:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+23:2403:x1875927402352512:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 224us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024104.502623:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 78 00000004:00200000:2.0:1789024104.502688:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789024104.502693:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024104.502715:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502728:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502737:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502744:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502750:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502756:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024104.502760:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502768:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502777:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:2.0:1789024104.502780:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024104.502784:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502789:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb3fd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502824:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502831:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502838:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502843:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024104.502846:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502852:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502860:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90cc33aa9a00) 00010000:00010000:2.0:1789024104.502862:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024104.502865:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.502871:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb3fdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.505852:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb3fce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af63e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.505878:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af63e expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024104.505911:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:2.0:1789024104.505913:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024104.505918:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323600, rc 0) 00000100:00100000:2.0:1789024104.506075:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11406:x1875927402352128:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 21055us (21343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024104.506084:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 141 00000040:00080000:1.0:1789024105.227543:0:14312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024105.227554:0:14312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024105.227587:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789024105.227596:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789024105.356336:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789024105.484463:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024105.484474:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024105.484502:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789024105.484511:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789024105.484704:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422343552:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024105.484856:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908300 going to sleep for 11 seconds 00000100:00100000:3.0:1789024105.495638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024105.496748:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422343552:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789024105.497202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352640 00000100:00100000:2.0:1789024105.497212:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352640 00000100:00100000:2.0:1789024105.497300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:2.0:1789024105.497310:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11418:x1875927402352640:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789024105.497346:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1789024105.497588:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024105.497836:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11418:x1875927402352640:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 525us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024105.497846:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:3.0:1789024105.515688:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024105.527140:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402352896 00000100:00100000:2.0:1789024105.527312:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402352896 00000100:00100000:2.0:1789024105.527393:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 143 00000100:00100000:2.0:1789024105.527405:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+22:11418:x1875927402352896:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024105.527558:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024105.527581:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3fea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af645 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024105.527689:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3ff1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024105.527721:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024105.527733:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024105.527747:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789024105.527947:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb3fea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af645 expref: 25 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024105.527966:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af645 expref: 24 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024105.528118:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:2.0:1789024105.528121:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024105.528125:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5c00, rc 0) 00000100:00100000:2.0:1789024105.528552:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+24:11418:x1875927402352896:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1146us (12873us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789024105.528561:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 143 00000100:00100000:2.0:1789024105.547032:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024105.547119:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024105.547735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402353280 00000100:00100000:1.0:1789024105.547746:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402353280 00000100:00100000:1.0:1789024105.547828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 144 00000100:00100000:1.0:1789024105.547838:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+24:11418:x1875927402353280:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789024105.547919:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.547937:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.547950:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548108:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548116:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548122:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548127:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024105.548537:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548546:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548559:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:1.0:1789024105.548562:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024105.548567:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024105.548572:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb3fff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024105.548809:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024105.548815:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024105.549344:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789024105.549355:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789024105.552005:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402353024 00000100:00100000:0.0:1789024105.552021:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402353024 00000100:00100000:0.0:1789024105.552106:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:0.0:1789024105.552116:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+26:2402:x1875927402353024:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024105.552141:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024105.552213:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb3ff1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af645 expref: 26 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024105.552235:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024105.552241:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024105.560006:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:11418:x1875927402353280:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 12149us (12866us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789024105.560021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 144 00000100:00100000:0.0:1789024105.562635:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+24:2402:x1875927402353024:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 10508us (15600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024105.562652:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:3.0:1789024105.569102:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024105.569760:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402353536 00000100:00100000:0.0:1789024105.569790:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402353536 00000100:00100000:0.0:1789024105.569854:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:0.0:1789024105.569868:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+24:11418:x1875927402353536:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789024105.570102:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+25:11418:x1875927402353536:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 234us (1010us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789024105.570110:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:3.0:1789024105.868957:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422343680:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024105.869024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024105.869191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422343680 00000100:00100000:1.0:1789024105.869199:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422343680 00000100:00100000:1.0:1789024105.869346:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789024105.869356:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422343680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024105.869386:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789024105.869429:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422343680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024105.869436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789024105.869573:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422343680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024106.380582:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024107.207436:0:14363:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789024107.207446:0:14363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789024107.207477:0:14363:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789024107.207483:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789024107.375191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024107.375297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402353792 00000100:00100000:0.0:1789024107.375308:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402353792 00000100:00080000:1.0:1789024107.375419:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024107.375463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 145 00000100:00100000:0.0:1789024107.375482:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+25:11438:x1875927402353792:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024107.375508:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024107.375529:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4006 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af64c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024107.375631:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb400d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024107.375646:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb400d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024107.375659:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb400d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024107.375669:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789024107.375802:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4006 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af64c expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024107.375817:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb400d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af64c expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024107.375825:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:0.0:1789024107.375828:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789024107.375832:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e200, rc 0) 00000100:00100000:0.0:1789024107.375899:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+27:11438:x1875927402353792:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 419us (717us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789024107.375907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 145 00000100:00100000:0.0:1789024107.384337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024107.384415:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402353920 00000100:00100000:3.0:1789024107.384425:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402353920 00000100:00100000:3.0:1789024107.384493:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 146 00000100:00100000:3.0:1789024107.384503:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+27:11438:x1875927402353920:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:3.0:1789024107.384579:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384597:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384610:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384646:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384653:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384672:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384677:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024107.384682:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384689:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384701:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024107.384704:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789024107.384709:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.384716:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb401b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024107.384802:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+27:11438:x1875927402353920:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 299us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024107.384809:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 146 00010000:00010000:3.0:1789024107.407290:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024107.466629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024107.466722:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354048 00000100:00100000:3.0:1789024107.466732:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354048 00000100:00100000:3.0:1789024107.466857:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:3.0:1789024107.466869:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402354048:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:3.0:1789024107.466890:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024107.466915:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125c89d6/0xa736ef4b98cb4022 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af653 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024107.466960:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa25767, atime: 0x6aa25767, ctime: 0x6aa25767, blocks: 0x8 00010000:00010000:3.0:1789024107.466981:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1789024107.466985:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024107.466994:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125c89d6/0xa736ef4b98cb4022 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af653 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.467013:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000125c89d6/0xa736ef4b98cb4022 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af653 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024107.467025:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:3.0:1789024107.467323:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2401:x1875927402354048:12345-192.168.202.18@tcp:101:cat.0 Request processed in 455us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024107.467331:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00080000:1.0:1789024107.467399:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024107.470714:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024107.470804:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354176 00000100:00100000:2.0:1789024107.470814:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354176 00002000:00100000:2.0:1789024107.470873:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90cc3fae2680 x1875927402354176/t0(0) o3->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:278/0 lens 488/0 e 0 to 0 dl 1789024118 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024107.470883:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3fae2680 with x1875927402354176 ext(0->4095) 00002000:00010000:2.0:1789024107.470888:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3fae2680 00000100:00100000:2.0:1789024107.470938:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024107.470947:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2401:x1875927402354176:12345-192.168.202.18@tcp:3:cat.0 00000100:00100000:2.0:1789024107.471175:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2401:x1875927402354176:12345-192.168.202.18@tcp:3:cat.0 Request processed in 228us (470us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789024107.471183:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00002000:00100000:2.0:1789024107.471191:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff90cc3fae2680 x1875927402354176/t0(0) o3->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:278/0 lens 488/4536 e 0 to 0 dl 1789024118 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024107.471200:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3fae2680 with x1875927402354176 ext(0->4095) 00002000:00010000:2.0:1789024107.471203:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3fae2680 00000040:00080000:3.0:1789024107.596704:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024107.596726:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024107.596747:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789024107.596757:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789024107.853588:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789024107.917561:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024107.918752:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422343808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024107.918906:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024107.918979:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422343808 00000100:00100000:0.0:1789024107.918999:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422343808 00000100:00100000:0.0:1789024107.919055:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789024107.919064:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422343808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024107.919101:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789024107.919175:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422343808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024107.919182:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789024107.920016:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422343808:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024108.433526:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789024108.940705:0:8902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426976555522ns, next at 427976552478ns, rc = 0 00000100:00100000:1.0:1789024108.940790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422343936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024108.940865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024108.941311:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422343936 00000100:00100000:0.0:1789024108.941321:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422343936 00000100:00100000:0.0:1789024108.942330:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789024108.942345:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422343936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024108.942374:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789024108.942438:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422343936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024108.942445:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789024108.942858:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422343936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024108.942886:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024108.942896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422344064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024108.942930:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024108.942969:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344064 00000100:00100000:3.0:1789024108.942975:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344064 00000100:00080000:1.0:1789024108.954089:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789024108.956898:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1789024108.957289:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789024108.957303:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422344064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024108.957339:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789024108.957440:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422344064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (14507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024108.957448:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789024108.957518:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422344064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024109.452805:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422344192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024109.452881:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024109.453248:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422344320:0@lo:400:kworker.0 00000100:00100000:1.0:1789024109.453290:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024109.453361:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344320 00000100:00100000:1.0:1789024109.453371:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344320 00000100:00100000:1.0:1789024109.453424:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789024109.453432:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024109.453486:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422344320:12345-0@lo:400:kworker.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024109.453493:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789024109.453537:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344192 00000100:00100000:2.0:1789024109.453542:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344192 00000100:00100000:1.0:1789024109.453549:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422344320:0@lo:400:kworker.0 00000100:00100000:2.0:1789024109.453630:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789024109.453638:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422344192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024109.453661:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024109.453700:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422344192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024109.453707:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789024109.453724:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789024109.453754:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024109.453774:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789024109.453780:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789024109.453795:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cc3fae0a80, transno 4294967305 00000100:00100000:2.0:1789024109.453812:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422344192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024109.454464:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422344576:0@lo:400:kworker.0 00000100:00100000:2.0:1789024109.454573:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024109.454606:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024109.454612:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024109.454636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024109.454676:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344448 00000100:00100000:2.0:1789024109.454682:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344448 00000100:00100000:2.0:1789024109.454721:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789024109.454729:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422344448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024109.454755:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024109.454792:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422344448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024109.454799:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1789024109.454816:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024109.454843:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422344448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024109.454872:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344576 00000100:00100000:2.0:1789024109.454876:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344576 00000100:00100000:2.0:1789024109.454913:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789024109.454920:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422344576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024109.454956:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422344576:12345-0@lo:400:kworker.0 Request processed in 37us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024109.454962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789024109.455002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422344576:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.459705:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422344960:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.459794:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.459832:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422345472:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.459857:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.459883:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789024109.459889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422345088:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.459937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.459960:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422345600:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.459983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460035:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344960 00000100:00100000:0.0:1789024109.460051:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344960 00000100:00100000:0.0:1789024109.460110:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789024109.460119:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460207:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422344960:12345-0@lo:400:kworker.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.460215:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789024109.460240:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345472 00000100:00100000:0.0:1789024109.460244:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345472 00000100:00100000:0.0:1789024109.460274:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789024109.460285:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422345472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460316:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc012ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422345472:12345-0@lo:400:kworker.0 Request processed in 35us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.460321:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789024109.460340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345088 00000100:00100000:0.0:1789024109.460343:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345088 00000100:00100000:0.0:1789024109.460378:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345600 00000100:00100000:0.0:1789024109.460381:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345600 00000100:00100000:0.0:1789024109.460402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789024109.460407:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460439:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422345088:12345-0@lo:400:kworker.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.460445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789024109.460459:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789024109.460465:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422345600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460492:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422345600:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.460497:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789024109.460553:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422345088:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460564:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422345600:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460572:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422344960:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460582:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422345472:0@lo:400:kworker.0 00000100:00080000:0.0:1789024109.460615:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024109.460627:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422344832:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460672:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422345344:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460710:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789024109.460716:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422344704:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460806:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460824:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422345216:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460861:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422345728:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.460883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024109.460905:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344832 00000100:00100000:0.0:1789024109.460909:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344832 00000100:00100000:0.0:1789024109.460932:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345216 00000100:00100000:0.0:1789024109.460934:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345216 00000100:00100000:0.0:1789024109.460949:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345728 00000100:00100000:0.0:1789024109.460952:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345728 00000100:00100000:0.0:1789024109.460964:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789024109.460970:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422344832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.461024:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422344832:12345-0@lo:400:kworker.0 Request processed in 54us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.461037:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789024109.461051:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789024109.461057:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422345216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.461096:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422345216:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.461103:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789024109.461116:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789024109.461121:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.461170:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875927422345728:12345-0@lo:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.461176:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:0.0:1789024109.461190:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789024109.461218:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03bee300 x1875927422345216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024109.461230:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422345216:0@lo:400:kworker.0 00010000:00080000:0.0:1789024109.461240:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc07484700 x1875927422345728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024109.461248:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422345728:0@lo:400:kworker.0 00000100:00100000:0.0:1789024109.461257:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422344832:0@lo:400:kworker.0 00000100:00100000:3.0:1789024109.463220:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345344 00000100:00100000:3.0:1789024109.463235:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345344 00000100:00100000:3.0:1789024109.463304:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789024109.463314:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024109.463412:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422345344:12345-0@lo:400:kworker.0 Request processed in 100us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024109.463420:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789024109.463476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422345344:0@lo:400:kworker.0 00000100:00100000:1.0:1789024109.463905:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422344704 00000100:00100000:1.0:1789024109.463911:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422344704 00000100:00100000:1.0:1789024109.463950:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789024109.463957:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024109.464018:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422344704:12345-0@lo:400:kworker.0 Request processed in 61us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024109.464025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789024109.465553:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422344704:0@lo:400:kworker.0 00000004:00080000:3.0:1789024109.470877:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789024109.471008:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1789024109.471055:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cc066d7000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789024109.471080:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc346c9b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cc066d7600 00000020:00080000:3.0:1789024109.471084:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc346c9500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cc014ad000 00000020:00080000:3.0:1789024109.471128:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789024109.471290:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789024109.471403:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789024109.471855:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024109.471883:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422345856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789024109.471981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024109.472205:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345856 00000100:00100000:3.0:1789024109.472220:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345856 00000100:00100000:3.0:1789024109.472293:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789024109.472306:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422345856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789024109.472532:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789024109.472536:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789024103 -> 1789024103 00002000:00010000:3.0:1789024109.472540:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1789024103 -> 1789024103 00002000:00010000:3.0:1789024109.472543:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789024103 -> 1789024103 00002000:00010000:3.0:1789024109.472546:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789024109.472638:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422345856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 334us (658us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789024109.472648:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1789024109.472743:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb03940700/2, rc 0, transno 4294967313 00000100:00100000:3.0:1789024109.472763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422345856:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789024109.474349:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474369:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474510:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474536:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024109.474541:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474551:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474570:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90cc33aa9200) 00010000:00010000:1.0:1789024109.474574:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024109.474579:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024109.474585:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb3f9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024109.476953:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789024109.476981:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:0.0:1789024109.591364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592006:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592048:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592140:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024109.592228:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354816 00000100:00100000:0.0:1789024109.592238:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354816 00000100:00100000:0.0:1789024109.592298:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354688 00000100:00100000:0.0:1789024109.592301:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354688 00000100:00100000:0.0:1789024109.592321:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 93 00000100:00100000:0.0:1789024109.592330:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402354816:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024109.592413:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402354816:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 83us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.592421:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 93 00000100:00100000:0.0:1789024109.592440:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00100000:0.0:1789024109.592447:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402354688:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024109.592471:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402354688:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.592478:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00100000:0.0:1789024109.592495:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354560 00000100:00100000:0.0:1789024109.592499:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354560 00000100:00100000:0.0:1789024109.592524:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355072 00000100:00100000:0.0:1789024109.592526:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355072 00000100:00100000:0.0:1789024109.592538:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354432 00000100:00100000:0.0:1789024109.592541:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354432 00000100:00100000:0.0:1789024109.592554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354944 00000100:00100000:0.0:1789024109.592556:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354944 00000100:00100000:0.0:1789024109.592568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 317 00000100:00100000:0.0:1789024109.592574:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402354560:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024109.592604:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402354560:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.592616:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 317 00000100:00100000:0.0:1789024109.592629:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 318 00000100:00100000:0.0:1789024109.592635:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402355072:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024109.592664:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402355072:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.592670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 318 00000100:00100000:0.0:1789024109.592681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 319 00000100:00100000:0.0:1789024109.592687:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+13:2403:x1875927402354432:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024109.592707:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+13:2403:x1875927402354432:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 21us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.592712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 319 00000100:00100000:0.0:1789024109.592722:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 320 00000100:00100000:0.0:1789024109.592728:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402354944:12345-192.168.202.18@tcp:400:kworker.0 00000100:00080000:3.0:1789024109.594200:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024109.594208:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024109.594211:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789024109.594214:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024109.594367:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402354944:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 1634us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024109.594376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 320 00000100:00100000:2.0:1789024109.598204:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402354304 00000100:00100000:2.0:1789024109.598218:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402354304 00000100:00100000:2.0:1789024109.598275:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 388 00000100:00100000:2.0:1789024109.598284:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402354304:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024109.598370:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402354304:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 86us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024109.598388:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 388 00010000:00010000:1.0:1789024110.476616:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024110.988446:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422345984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024110.988522:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024110.988723:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422345984 00000100:00100000:1.0:1789024110.988747:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422345984 00000100:00100000:1.0:1789024110.988811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789024110.988822:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422345984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024110.988858:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789024110.988978:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422345984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024110.988984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789024110.989217:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422345984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024111.501303:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024112.528237:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024112.567008:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024112.567386:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355200 00000100:00100000:0.0:1789024112.567397:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355200 00000100:00100000:1.0:1789024112.567672:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 147 00000100:00100000:1.0:1789024112.567685:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11081:x1875927402355200:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789024112.567808:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11081:x1875927402355200:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 Request processed in 125us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024112.567829:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 147 00000100:00080000:3.0:1789024112.568846:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024112.569534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024112.569842:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355328 00000100:00100000:3.0:1789024112.569851:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355328 00000100:00100000:3.0:1789024112.569938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 148 00000100:00100000:3.0:1789024112.569949:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:11081:x1875927402355328:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789024112.570041:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:11081:x1875927402355328:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 Request processed in 95us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024112.570232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 148 00000100:00080000:0.0:1789024112.570296:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024112.576010:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024112.580617:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355584 00000100:00100000:2.0:1789024112.580632:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355584 00000100:00100000:2.0:1789024112.580861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:2.0:1789024112.580879:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+13:11081:x1875927402355584:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789024112.581520:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:11081:x1875927402355584:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 645us (5520us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789024112.581528:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:0.0:1789024113.038444:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024113.038474:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422346112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024113.038588:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024113.038878:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346112 00000100:00100000:1.0:1789024113.038897:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346112 00000100:00100000:1.0:1789024113.038952:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789024113.038963:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422346112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024113.038997:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024113.039340:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422346112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 378us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024113.039349:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789024113.044175:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422346112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024113.553812:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024114.063262:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422346240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024114.063347:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024114.064203:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346240 00000100:00100000:2.0:1789024114.064213:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346240 00000100:00100000:2.0:1789024114.064278:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789024114.064289:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422346240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024114.064319:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789024114.064374:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422346240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024114.064389:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789024114.064535:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024114.064576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422346240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024114.077337:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422346368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024114.077416:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024114.077506:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346368 00000100:00100000:3.0:1789024114.077514:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346368 00000100:00100000:3.0:1789024114.077570:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789024114.077579:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422346368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024114.077602:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789024114.077648:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422346368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024114.077655:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789024114.077675:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024114.081030:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789024114.081044:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:3.0:1789024114.081208:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb03940700, transno 4294967313 00000100:00100000:3.0:1789024114.081249:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422346368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024114.573198:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422346496:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573301:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422347008:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573429:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422347520:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573478:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789024114.573483:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422346624:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573522:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422347136:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422347648:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573590:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573615:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422346752:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573664:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422347264:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573686:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573715:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422347776:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573757:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789024114.573762:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422346880:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573946:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422347392:0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.573969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024114.573997:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346496 00000100:00100000:1.0:1789024114.574006:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346496 00000100:00100000:1.0:1789024114.574050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789024114.574059:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422346496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.574110:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3643:x1875927422346496:12345-0@lo:400:kworker.0 Request processed in 51us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.574117:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789024114.574178:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347008 00000100:00100000:1.0:1789024114.574183:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347008 00000100:00100000:1.0:1789024114.574205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346752 00000100:00100000:1.0:1789024114.574207:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346752 00000100:00100000:1.0:1789024114.574218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789024114.574223:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422347008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.574256:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422347008:12345-0@lo:400:kworker.0 Request processed in 32us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.574262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789024114.574275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789024114.574281:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422346752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.574323:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422346752:12345-0@lo:400:kworker.0 Request processed in 42us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.574329:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789024114.574349:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347520 00000100:00100000:1.0:1789024114.574352:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347520 00000100:00100000:1.0:1789024114.574382:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346624 00000100:00100000:1.0:1789024114.574385:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346624 00000100:00100000:1.0:1789024114.574393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347136 00000100:00100000:1.0:1789024114.574396:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347136 00000100:00100000:1.0:1789024114.574407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347264 00000100:00100000:1.0:1789024114.574409:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347264 00000100:00100000:1.0:1789024114.574419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422346880 00000100:00100000:1.0:1789024114.574421:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422346880 00000100:00100000:1.0:1789024114.574431:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347392 00000100:00100000:1.0:1789024114.574433:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347392 00000100:00100000:1.0:1789024114.574445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789024114.574450:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422347520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024114.574496:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422347520:12345-0@lo:400:kworker.0 Request processed in 46us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.574502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789024114.574517:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789024114.574524:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575212:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347648 00000100:00100000:0.0:1789024114.575220:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347648 00000100:00100000:0.0:1789024114.575251:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347776 00000100:00100000:0.0:1789024114.575254:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347776 00000100:00100000:0.0:1789024114.575273:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789024114.575280:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422347648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575317:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422347648:12345-0@lo:400:kworker.0 Request processed in 39us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575322:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789024114.575335:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789024114.575340:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575366:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422347776:12345-0@lo:400:kworker.0 Request processed in 27us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575372:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789024114.575391:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789024114.575398:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422347136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575425:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422347136:12345-0@lo:400:kworker.0 Request processed in 29us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575431:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789024114.575445:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789024114.575451:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422347264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575476:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422347264:12345-0@lo:400:kworker.0 Request processed in 27us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575482:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789024114.575495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789024114.575510:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422346880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575554:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422346880:12345-0@lo:400:kworker.0 Request processed in 45us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575559:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789024114.575574:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789024114.575580:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422347392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024114.575607:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422347392:12345-0@lo:400:kworker.0 Request processed in 28us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.575613:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789024114.575975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024114.575988:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422348032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024114.576026:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024114.576057:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422348032 00000100:00100000:2.0:1789024114.576061:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422348032 00000100:00100000:1.0:1789024114.578878:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422346624:12345-0@lo:400:kworker.0 Request processed in 4346us (5364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.578892:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1789024114.578948:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789024114.578954:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024114.578958:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024114.578975:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422347904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024114.579031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024114.582446:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024114.582517:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422346880:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582536:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422347392:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582548:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422346752:0@lo:400:kworker.0 00010000:00080000:3.0:1789024114.582563:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae6a00 x1875927422347264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024114.582574:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422347264:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422347776:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422346624:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582650:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422347136:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582661:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422347648:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:3643:1875927422346496:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.582681:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422347008:0@lo:400:kworker.0 00010000:00080000:3.0:1789024114.582692:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae5f80 x1875927422347520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024114.591078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422347520:0@lo:400:kworker.0 00000100:00100000:3.0:1789024114.596266:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422347904 00000100:00100000:3.0:1789024114.596284:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422347904 00000100:00100000:3.0:1789024114.596338:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789024114.596348:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422348032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024114.596415:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024114.596503:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422348032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (20475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024114.596510:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789024114.596564:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422348032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024114.596591:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789024114.596598:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422347904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024114.596607:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024114.596634:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422347904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (17603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024114.596639:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789024114.603837:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422347904:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024114.723313:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723343:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723386:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024114.723469:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356224 00000100:00100000:2.0:1789024114.723478:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356224 00000100:00100000:2.0:1789024114.723522:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356096 00000100:00100000:2.0:1789024114.723525:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356096 00000100:00100000:2.0:1789024114.723547:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 97 00000100:00100000:2.0:1789024114.723556:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402356224:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.723675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355712 00000100:00100000:1.0:1789024114.723680:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355712 00000100:00100000:1.0:1789024114.723721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 390 00000100:00100000:1.0:1789024114.723729:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402355712:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.723793:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402355712:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 65us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.723801:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 390 00000100:00100000:1.0:1789024114.723839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355840 00000100:00100000:1.0:1789024114.723842:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355840 00000100:00100000:1.0:1789024114.723896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402355968 00000100:00100000:1.0:1789024114.723900:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402355968 00000100:00100000:1.0:1789024114.723915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356480 00000100:00100000:1.0:1789024114.723918:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356480 00000100:00100000:1.0:1789024114.723929:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356352 00000100:00100000:1.0:1789024114.723931:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356352 00000100:00100000:1.0:1789024114.723944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 327 00000100:00100000:1.0:1789024114.723950:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:2403:x1875927402355840:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.723983:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:2403:x1875927402355840:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 33us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.723990:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 327 00000100:00100000:1.0:1789024114.724005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 328 00000100:00100000:1.0:1789024114.724011:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402355968:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.724037:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402355968:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.724043:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 328 00000100:00100000:1.0:1789024114.724062:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 329 00000100:00100000:1.0:1789024114.724068:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402356480:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.724093:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402356480:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.724100:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 329 00000100:00100000:1.0:1789024114.724113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 330 00000100:00100000:1.0:1789024114.724119:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402356352:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024114.724140:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402356352:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 22us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024114.724166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 330 00000100:00080000:1.0:1789024114.724183:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024114.724187:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024114.724189:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789024114.724191:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024114.724612:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 98 00000100:00100000:0.0:1789024114.724623:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402356096:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024114.724673:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402356096:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 52us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024114.724681:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 98 00000100:00100000:2.0:1789024114.725081:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402356224:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 1525us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024114.725088:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 97 00000001:02000400:3.0:1789024114.739084:0:14561:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:08:33 (1789024113) 00000001:00080000:2.0:1789024115.091861:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1789024115.092129:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789024115.093089:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789024115.093104:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789024115.596432:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024116.069288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024116.069395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356736 00000100:00100000:2.0:1789024116.069405:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356736 00000100:00100000:2.0:1789024116.069531:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00100000:2.0:1789024116.069543:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+13:12156:x1875927402356736:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024116.069578:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024116.069612:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4029 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af65a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069721:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069736:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069749:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069777:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069784:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069791:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069894:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb403e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb403e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.069911:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb403e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024116.069921:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789024116.070035:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070043:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070050:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070056:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024116.070059:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070067:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070078:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cb0231bd00) 00010000:00010000:2.0:1789024116.070081:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024116.070086:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070092:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4030 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070109:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070115:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070121:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070135:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024116.070138:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070198:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070209:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90cc41bc7300) 00010000:00010000:2.0:1789024116.070211:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024116.070214:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070220:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4037 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070473:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4029 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af65a expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070488:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb403e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af65a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024116.070496:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:2.0:1789024116.070498:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024116.070501:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4200, rc 0) 00000100:00100000:2.0:1789024116.070556:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+15:12156:x1875927402356736:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1017us (1277us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789024116.070564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00080000:1.0:1789024116.070819:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024116.074561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024116.074668:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356864 00000100:00100000:1.0:1789024116.074680:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356864 00000100:00100000:2.0:1789024116.076316:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024116.076568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:1.0:1789024116.076581:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+15:12156:x1875927402356864:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789024116.076705:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+15:12156:x1875927402356864:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 126us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024116.076712:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:0.0:1789024116.076997:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402356992 00000100:00100000:0.0:1789024116.077007:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402356992 00000100:00100000:0.0:1789024116.077056:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:0.0:1789024116.077065:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+15:2401:x1875927402356992:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024116.077077:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024116.077100:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb403e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af65a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024116.077122:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:0.0:1789024116.077135:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024116.077187:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f195c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+14:2401:x1875927402356992:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 123us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024116.077194:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:3.0:1789024116.078900:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024116.087424:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402357120 00000100:00100000:2.0:1789024116.087441:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402357120 00000100:00100000:2.0:1789024116.087534:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00100000:2.0:1789024116.087546:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:12156:x1875927402357120:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789024116.087651:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+5:12156:x1875927402357120:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 108us (8758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024116.087659:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00080000:3.0:1789024116.087996:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024116.108501:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024116.108528:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422348160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024116.108603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024116.108793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422348160 00000100:00100000:1.0:1789024116.108803:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422348160 00000100:00100000:1.0:1789024116.108868:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789024116.108891:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422348160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024116.108925:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789024116.108981:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422348160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024116.108988:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789024116.109251:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422348160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024116.620635:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789024116.814034:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024116.814045:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024116.814565:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789024116.814577:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789024117.068771:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789024117.648989:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789024117.839739:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024117.839749:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024117.839854:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789024117.839861:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789024118.156930:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789024118.156955:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422348288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024118.157028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024118.157307:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422348288 00000100:00100000:1.0:1789024118.157317:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422348288 00000100:00100000:1.0:1789024118.157369:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789024118.157379:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422348288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024118.157415:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024118.157470:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422348288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024118.157477:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789024118.157535:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422348288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024118.157888:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.158020:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402357248 00000100:00100000:3.0:1789024118.158026:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402357248 00000100:00100000:3.0:1789024118.158081:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 152 00000100:00100000:3.0:1789024118.158103:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+14:12197:x1875927402357248:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024118.158117:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024118.158215:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb404c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af661 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158298:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158314:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158330:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158345:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158351:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158357:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158415:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158423:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158429:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158444:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024118.158449:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158456:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158469:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024118.158472:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024118.158476:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158482:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158494:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158500:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158506:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158510:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024118.158513:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158519:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158535:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90cb0231ad00) 00010000:00010000:3.0:1789024118.158538:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024118.158541:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158546:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb405a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158583:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb404c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af661 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158593:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024118.158595:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024118.158598:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb404c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af661 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.158606:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00080000:2.0:1789024118.158787:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024118.159724:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+14:12197:x1875927402357248:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 563us (777us total) trans 0 rc 301/301 00000100:00100000:3.0:1789024118.159739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 152 00000100:00100000:1.0:1789024118.168354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.168423:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402357504 00000100:00100000:3.0:1789024118.168433:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402357504 00000100:00100000:3.0:1789024118.168495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 153 00000100:00100000:3.0:1789024118.168505:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+14:12197:x1875927402357504:12345-192.168.202.18@tcp:36:lfs.0 00010000:00010000:3.0:1789024118.168564:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024118.168594:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb39ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af48c expref: 14 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168626:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024118.168638:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024118.168707:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168720:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168731:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168745:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168752:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.168760:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169347:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169359:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169367:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024118.169381:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bb10d27 reply state 000000006cac6eb5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169402:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169409:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024118.169412:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024118.169415:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789024118.169420:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789024118.169427:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169434:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169442:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169448:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024118.169453:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169461:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169468:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231ab00) 00010000:00010000:3.0:1789024118.169471:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024118.169474:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169480:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4061 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024118.169503:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bb10d27 reply state 000000006cac6eb5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169511:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.169517:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90cb0231a600) 00010000:00010000:3.0:1789024118.169519:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024118.169521:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789024118.169624:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+15:12197:x1875927402357504:12345-192.168.202.18@tcp:36:lfs.0 Request processed in 1119us (1278us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789024118.169632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 153 00000100:00100000:2.0:1789024118.325267:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.325433:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402357632 00000100:00100000:0.0:1789024118.325444:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402357632 00000100:00100000:0.0:1789024118.325512:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 154 00000100:00100000:0.0:1789024118.325523:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+15:12206:x1875927402357632:12345-192.168.202.18@tcp:101:lctl.0 00010000:00010000:0.0:1789024118.325551:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024118.325577:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af668 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.325642:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.325656:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.325824:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024118.326427:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789024118.326432:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024118.326461:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.326490:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af668 expref: 17 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.326526:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af668 expref: 16 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.326535:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:0.0:1789024118.326538:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024118.326542:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f800, rc 0) 00000100:00100000:0.0:1789024118.326604:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+16:12206:x1875927402357632:12345-192.168.202.18@tcp:101:lctl.0 Request processed in 1082us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024118.326611:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 154 00000100:00100000:3.0:1789024118.374363:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.374956:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402357760 00000100:00100000:2.0:1789024118.374969:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402357760 00000100:00100000:2.0:1789024118.375262:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 155 00000100:00100000:2.0:1789024118.375274:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+16:12212:x1875927402357760:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024118.375295:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024118.375317:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af66f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375381:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375396:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375424:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375436:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375443:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375449:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375531:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375540:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375547:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024118.375583:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789024118.375587:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024118.375607:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375619:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375626:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375643:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375650:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024118.375654:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375678:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375691:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:2.0:1789024118.375694:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024118.375699:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375705:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb408b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375721:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375726:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375732:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375737:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024118.375739:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375755:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375764:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90cb0231a600) 00010000:00010000:2.0:1789024118.375766:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024118.375769:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375775:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4092 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375805:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af66f expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375818:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af66f expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.375826:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024118.375828:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789024118.375830:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5200, rc 0) 00000100:00100000:2.0:1789024118.376075:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+17:12212:x1875927402357760:12345-192.168.202.18@tcp:101:bash.0 Request processed in 802us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024118.376083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 155 00000100:00100000:1.0:1789024118.381363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.381452:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358016 00000100:00100000:2.0:1789024118.381463:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358016 00000100:00100000:2.0:1789024118.381532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 156 00000100:00100000:2.0:1789024118.381543:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+17:12212:x1875927402358016:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024118.381580:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024118.381602:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb40a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af676 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381728:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381744:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381755:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381815:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381823:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.381831:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789024118.382222:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789024118.382352:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382361:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382368:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382413:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382419:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382426:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382432:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024118.382435:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382442:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382454:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024118.382458:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024118.382462:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382467:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb40a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024118.382483:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a3cf74a reply state 000000001be87114 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382494:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382500:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:2.0:1789024118.382509:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024118.382512:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789024118.382546:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb40a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382563:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.382571:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:2.0:1789024118.382573:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024118.382576:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030800, rc 0) 00000100:00100000:2.0:1789024118.382654:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:12212:x1875927402358016:12345-192.168.202.18@tcp:101:bash.0 Request processed in 1111us (1301us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789024118.382674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 156 00000100:00100000:3.0:1789024118.387745:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.388246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358144 00000100:00100000:0.0:1789024118.388256:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358144 00000100:00100000:0.0:1789024118.388329:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:0.0:1789024118.388341:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2400:x1875927402358144:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:0.0:1789024118.388358:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024118.388379:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af67d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024118.388405:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024118.388426:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=436s v=(0 0) 00010000:00010000:0.0:1789024118.388431:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024118.388440:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.388458:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.388493:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024118.388551:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2400:x1875927402358144:12345-192.168.202.18@tcp:101:bash.0 Request processed in 213us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024118.388559:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00080000:3.0:1789024118.389091:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024118.392420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.392596:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358272 00000100:00100000:0.0:1789024118.392606:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358272 00000100:00100000:0.0:1789024118.392680:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:0.0:1789024118.392691:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+6:12212:x1875927402358272:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:0.0:1789024118.392709:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024118.392727:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af684 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.392759:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.392768:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024118.392772:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024118.392777:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.392814:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.392827:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024118.393097:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875927422348416:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024118.393298:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908840 going to sleep for 11 seconds 00000100:00100000:2.0:1789024118.397714:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875927422348416:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024118.397755:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.397776:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f600, rc 0) 00000100:00100000:2.0:1789024118.398301:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:12212:x1875927402358272:12345-192.168.202.18@tcp:101:bash.0 Request processed in 5610us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024118.398312:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:1.0:1789024118.399364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.402254:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358400 00000100:00100000:0.0:1789024118.402268:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358400 00010000:00010000:0.0:1789024118.402314:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024118.402397:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 79 00000100:00100000:0.0:1789024118.402407:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402358400:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024118.402420:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024118.402443:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.402457:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.402480:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb40c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af67d expref: 7 pid: 8432 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.402497:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024118.402501:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024118.402510:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.402539:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.402577:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024118.402590:0:6501:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1875927422348544:192.168.202.18@tcp:105: 00000100:00100000:0.0:1789024118.402694:0:6501:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908840 going to sleep for 11 seconds 00000100:00100000:0.0:1789024118.408220:0:6501:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6501:1875927422348544:192.168.202.18@tcp:105: 00010000:00010000:0.0:1789024118.408252:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024118.408315:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402358400:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 5908us (8955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024118.408326:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 79 00000100:00100000:3.0:1789024118.408456:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.411192:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358656 00000100:00100000:2.0:1789024118.411205:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358656 00000100:00100000:2.0:1789024118.411282:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:2.0:1789024118.411293:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+20:12212:x1875927402358656:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:2.0:1789024118.411604:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12212:x1875927402358656:12345-192.168.202.18@tcp:35:bash.0 Request processed in 311us (3147us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789024118.411625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:3.0:1789024118.515605:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.515736:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402358912 00000100:00100000:0.0:1789024118.515747:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402358912 00000100:00100000:0.0:1789024118.515807:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 157 00000100:00100000:0.0:1789024118.515817:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12222:x1875927402358912:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024118.515840:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024118.515868:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb40d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af68b expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024118.515970:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789024118.516090:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb40d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af68b expref: 23 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.516125:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:0.0:1789024118.516128:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024118.516133:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb40d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af68b expref: 23 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.516184:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024118.516236:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02603800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+22:12222:x1875927402358912:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 421us (641us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789024118.516243:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 157 00000100:00100000:3.0:1789024118.518610:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.522460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402359168 00000100:00100000:2.0:1789024118.522475:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402359168 00000100:00100000:2.0:1789024118.522792:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:2.0:1789024118.522804:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+22:12222:x1875927402359168:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024118.523077:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+23:12222:x1875927402359168:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 275us (4473us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789024118.523086:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:2.0:1789024118.623340:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.623778:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402359296 00000100:00100000:3.0:1789024118.623790:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402359296 00000100:00100000:3.0:1789024118.623884:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 158 00000100:00100000:3.0:1789024118.623895:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+23:12228:x1875927402359296:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024118.623925:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024118.623949:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb40df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af692 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624035:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624082:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024118.624127:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789024118.624132:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024118.624185:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624213:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb40df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af692 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624230:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af692 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.624239:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024118.624241:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024118.624249:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789024118.624320:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+24:12228:x1875927402359296:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 427us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024118.624328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 158 00000100:00100000:3.0:1789024118.629364:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.629459:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402359552 00000100:00100000:2.0:1789024118.629468:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402359552 00000100:00100000:2.0:1789024118.629533:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 159 00000100:00100000:2.0:1789024118.629543:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+24:12228:x1875927402359552:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024118.629564:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024118.629585:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb40ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af699 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.629722:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb40f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.629737:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.629749:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024118.629759:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789024118.629884:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb40ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af699 expref: 27 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.629904:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb40f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af699 expref: 26 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.629912:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:2.0:1789024118.629916:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024118.629919:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:2.0:1789024118.629991:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12228:x1875927402359552:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 449us (637us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789024118.629998:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 159 00000100:00100000:0.0:1789024118.638122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.640037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402359808 00000100:00100000:1.0:1789024118.640058:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402359808 00000100:00100000:1.0:1789024118.640139:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 160 00000100:00100000:1.0:1789024118.640184:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12228:x1875927402359808:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024118.640232:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024118.640260:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb4102 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6a0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024118.640293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00010000:00010000:1.0:1789024118.640375:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.640393:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.640406:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024118.640422:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789024118.640548:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb4102 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a0 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.640569:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a0 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.640577:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:1.0:1789024118.640580:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789024118.640583:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323400, rc 0) 00000100:00100000:1.0:1789024118.640647:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+28:12228:x1875927402359808:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 500us (2536us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789024118.640656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 160 00000100:00100000:0.0:1789024118.641268:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402359936 00000100:00100000:0.0:1789024118.641277:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402359936 00000100:00100000:0.0:1789024118.641323:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:0.0:1789024118.641332:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+28:2402:x1875927402359936:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024118.641345:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024118.641360:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb40f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af699 expref: 28 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.641375:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:0.0:1789024118.641379:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024118.641417:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+27:2402:x1875927402359936:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 86us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024118.641423:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:2.0:1789024118.654194:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.654332:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360064 00000100:00100000:3.0:1789024118.654343:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360064 00000100:00100000:3.0:1789024118.654403:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:3.0:1789024118.654414:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2401:x1875927402360064:12345-192.168.202.18@tcp:1:lfs.0 00010000:00010000:3.0:1789024118.654478:0:10202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.654511:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.654520:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024118.654525:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024118.654530:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.654565:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.654580:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 6 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024118.654595:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10202:1875927422348672:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024118.655002:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc0a627cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024118.663414:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f90ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10202:1875927422348672:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024118.663415:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00010000:00010000:3.0:1789024118.663441:0:10202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024118.663515:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360192 00000100:00100000:2.0:1789024118.663523:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360192 00002000:00100000:2.0:1789024118.663579:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90cb03a3c380 x1875927402360192/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:289/0 lens 504/0 e 0 to 0 dl 1789024129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024118.663590:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb03a3c380 with x1875927402360192 ext(0->12) 00010000:00010000:2.0:1789024118.663597:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 7 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.663613:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 7 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024118.663621:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cb03a3c380 00000100:00100000:2.0:1789024118.663712:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:2.0:1789024118.663733:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402360192:12345-192.168.202.18@tcp:4:lfs.0 00000100:00100000:2.0:1789024118.668208:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402360192:12345-192.168.202.18@tcp:4:lfs.0 Request processed in 4465us (4789us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789024118.668222:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00002000:00100000:2.0:1789024118.668234:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90cb03a3c380 x1875927402360192/t4294967306(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:289/0 lens 504/448 e 0 to 0 dl 1789024129 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024118.668244:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cb03a3c380 with x1875927402360192 ext(0->12) 00010000:00010000:2.0:1789024118.668255:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.668273:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024118.668281:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cb03a3c380 00010000:00010000:3.0:1789024118.681973:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024118.685407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.686081:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360320 00000100:00100000:1.0:1789024118.686092:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360320 00010000:00010000:1.0:1789024118.686196:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.686229:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 80 00000100:00100000:1.0:1789024118.686238:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2400:x1875927402360320:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024118.686251:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789024118.686267:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789024118.686270:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789024118 00002000:00010000:1.0:1789024118.686273:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789024119 00002000:00010000:1.0:1789024118.686275:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789024118 00002000:00010000:1.0:1789024118.686277:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789024118.686283:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.686296:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.686317:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded767d4/0xa736ef4b98cb40ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af684 expref: 9 pid: 8431 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.686333:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024118.686337:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024118.686343:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.686353:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.686444:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024118.686514:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2400:x1875927402360320:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 277us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024118.686522:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 80 00010000:00010000:3.0:1789024118.688457:0:10202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688547:0:10202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688579:0:10202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688588:0:10202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688597:0:10202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688605:0:10202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024118.688610:0:10202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688620:0:10202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688839:0:10202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.688850:0:10202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c52c41c/0xa736ef4b98cb4117 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.689508:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2401:x1875927402360064:12345-192.168.202.18@tcp:1:lfs.0 Request processed in 35080us (35353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024118.689519:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:2.0:1789024118.695542:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.701121:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360576 00000100:00100000:1.0:1789024118.701137:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360576 00000100:00100000:1.0:1789024118.702090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:1.0:1789024118.702103:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12228:x1875927402360576:12345-192.168.202.18@tcp:35:lfs.0 00000004:00010000:1.0:1789024118.702202:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a0 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024118.702391:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789024118.702420:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789024118.702736:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789024118.702772:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.702788:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.702797:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.702831:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.702875:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 31 pid: 6516 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.702892:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875927422348800:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024118.702996:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789024118.708599:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.708768:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360704 00000100:00100000:3.0:1789024118.708779:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360704 00010000:00010000:3.0:1789024118.708817:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 32 pid: 6516 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024118.708873:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 81 00000100:00100000:3.0:1789024118.708883:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:2403:x1875927402360704:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024118.708898:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024118.708905:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 32 pid: 6516 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.708918:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 32 pid: 6516 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.708939:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:3.0:1789024118.708945:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.708954:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.708961:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.708980:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024118.709044:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+32:2403:x1875927402360704:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 162us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024118.709068:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 81 00010000:00010000:1.0:1789024118.710382:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb40b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af676 expref: 31 pid: 6516 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.710408:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875927422348800:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024118.710433:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.710443:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.710450:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024118.710568:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789024118.712199:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789024118.712330:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422348928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789024118.712396:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024118.712432:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024118.712629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422348928 00000100:00100000:0.0:1789024118.712653:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422348928 00000100:00100000:0.0:1789024118.712867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789024118.712878:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422348928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789024118.712991:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422348928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024118.712999:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789024118.713038:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422348928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789024118.713219:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00080000:3.0:1789024118.713239:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024118.713276:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa42a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422349056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789024118.713313:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024118.713341:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789024118.713360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349056 00000100:00100000:3.0:1789024118.713364:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349056 00000100:00100000:2.0:1789024118.716751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789024118.716776:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875927422349056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789024118.717196:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa42a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875927422349056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789024118.717270:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789024118.717318:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717329:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717337:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717344:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024118.717349:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717357:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717372:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:3.0:1789024118.717375:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789024118.717381:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024118.717387:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb411e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024118.717490:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789024118.717569:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789024118.717581:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436753434163ns, next at 437753431536ns, rc = 0 00000001:00080000:3.0:1789024118.717588:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789024118.717615:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7b00) 00010000:00010000:3.0:1789024118.717618:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789024118.717625:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323400/0xa736ef4b98cb4109 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a0 expref: 35 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024118.717786:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1875927422349056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1020us (4471us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789024118.717804:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789024118.721113:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+34:12228:x1875927402360576:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 18999us (25572us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789024118.721130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 38 00000020:00080000:3.0:1789024118.721139:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789024118.725888:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024118.725990:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402360832 00000100:00100000:2.0:1789024118.726000:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402360832 00000100:00100000:2.0:1789024118.726076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 161 00000100:00100000:2.0:1789024118.726087:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+34:12228:x1875927402360832:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024118.726111:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024118.726137:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4125 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6a7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.726238:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4125 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a7 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.726254:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4125 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a7 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024118.726272:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:2.0:1789024118.726275:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024118.726279:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5400, rc 0) 00000100:00100000:2.0:1789024118.726344:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+35:12228:x1875927402360832:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 259us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024118.726350:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 161 00000100:00100000:0.0:1789024118.734620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.734691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402361088 00000100:00100000:3.0:1789024118.734705:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402361088 00000100:00100000:3.0:1789024118.734783:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:3.0:1789024118.734796:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+35:12228:x1875927402361088:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024118.735090:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+36:12228:x1875927402361088:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 295us (483us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789024118.735098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:3.0:1789024118.846476:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024118.846588:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402361344 00000100:00100000:0.0:1789024118.846600:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402361344 00000100:00100000:0.0:1789024118.846681:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 162 00000100:00100000:0.0:1789024118.846692:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+36:12238:x1875927402361344:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024118.846721:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024118.846744:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb412c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6ae expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024118.846845:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789024118.847360:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb412c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ae expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.847374:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:0.0:1789024118.847377:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024118.847382:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb412c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ae expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024118.847395:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e400, rc 0) 00000100:00100000:0.0:1789024118.847507:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12238:x1875927402361344:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 816us (1041us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1789024118.847529:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 162 00000100:00100000:0.0:1789024118.851821:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.855420:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402361472 00000100:00100000:1.0:1789024118.855437:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402361472 00000100:00100000:1.0:1789024118.855562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 163 00000100:00100000:1.0:1789024118.855573:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12238:x1875927402361472:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:1.0:1789024118.855687:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855707:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855720:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855731:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855739:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855746:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855823:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855831:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855839:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024118.855909:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855921:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855939:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855947:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855953:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.855958:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855965:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855977:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:1.0:1789024118.855980:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024118.855985:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.855991:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb413a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856006:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856535:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856542:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856547:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.856557:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856564:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856574:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:1.0:1789024118.856576:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024118.856579:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856585:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4141 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856595:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856601:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856607:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856612:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.856614:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856619:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856625:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024118.856627:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024118.856635:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.856641:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.856744:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12238:x1875927402361472:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 1171us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024118.856752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 163 00000100:00100000:0.0:1789024118.860575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.860798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402361728 00000100:00100000:3.0:1789024118.860809:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402361728 00000100:00100000:3.0:1789024118.860974:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:3.0:1789024118.860986:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12238:x1875927402361728:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024118.861247:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:12238:x1875927402361728:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 263us (680us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789024118.861255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:2.0:1789024118.901543:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.901767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402361984 00000100:00100000:1.0:1789024118.901777:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402361984 00000100:00100000:1.0:1789024118.901838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 164 00000100:00100000:1.0:1789024118.901847:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:12241:x1875927402361984:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024118.901883:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024118.901904:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb414f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.901977:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.901991:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902002:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902023:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902031:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902056:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902207:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902216:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902223:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024118.902232:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789024118.902311:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902319:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902326:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902332:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.902336:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902344:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902356:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:1.0:1789024118.902359:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024118.902373:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902379:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4156 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902392:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902397:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902402:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902407:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.902410:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902416:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902423:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:1.0:1789024118.902425:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024118.902428:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902433:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb415d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902469:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb414f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902495:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.902502:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024118.902505:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024118.902507:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322800, rc 0) 00000100:00100000:1.0:1789024118.902562:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12241:x1875927402361984:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 715us (1029us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789024118.902569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 164 00000100:00100000:0.0:1789024118.905896:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024118.906355:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402362112 00000100:00100000:1.0:1789024118.906367:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402362112 00000100:00100000:1.0:1789024118.906432:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 165 00000100:00100000:1.0:1789024118.906443:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12241:x1875927402362112:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:1.0:1789024118.906512:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906530:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906542:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906576:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906583:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906608:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906614:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024118.906618:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906626:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906652:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024118.906667:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024118.906672:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024118.906679:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024118.906753:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12241:x1875927402362112:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 311us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024118.906760:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 165 00000100:00100000:0.0:1789024118.909306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024118.909541:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402362368 00000100:00100000:3.0:1789024118.909552:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402362368 00000100:00100000:3.0:1789024118.909609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:3.0:1789024118.909620:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12241:x1875927402362368:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024118.910357:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+41:12241:x1875927402362368:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 735us (1057us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789024118.910367:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:3.0:1789024119.180408:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024119.180430:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422349184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024119.180495:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.180701:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422349312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024119.180732:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.180769:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349184 00000100:00100000:2.0:1789024119.180776:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349184 00000100:00100000:2.0:1789024119.180837:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349312 00000100:00100000:2.0:1789024119.180840:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349312 00000100:00100000:2.0:1789024119.180871:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789024119.180879:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422349184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024119.180906:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789024119.180947:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422349184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.180953:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789024119.180969:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789024119.180975:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422349312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024119.180984:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789024119.181175:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422349312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.181181:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789024119.181198:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024119.181230:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422349312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024119.181452:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3c024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422349184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024119.236247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024119.236338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402362624 00000100:00100000:1.0:1789024119.236348:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402362624 00000100:00100000:1.0:1789024119.236413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 166 00000100:00100000:1.0:1789024119.236424:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+41:12272:x1875927402362624:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:1.0:1789024119.236450:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024119.236472:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4179 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.236617:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4180 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.236631:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.236643:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4180 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024119.236664:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789024119.236772:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb4179 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6bc expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.236790:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4180 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6bc expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.236798:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024119.236801:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024119.236805:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323800, rc 0) 00000100:00100000:1.0:1789024119.236877:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12272:x1875927402362624:12345-192.168.202.18@tcp:101:cat.0 Request processed in 454us (641us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789024119.236884:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 166 00000100:00100000:1.0:1789024119.252915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.253350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402362880 00000100:00100000:3.0:1789024119.253361:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402362880 00000100:00100000:3.0:1789024119.253433:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:3.0:1789024119.253444:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12272:x1875927402362880:12345-192.168.202.18@tcp:35:cat.0 00000100:00100000:3.0:1789024119.254203:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+44:12272:x1875927402362880:12345-192.168.202.18@tcp:35:cat.0 Request processed in 757us (1293us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789024119.254213:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:0.0:1789024119.269835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024119.270198:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363008 00000100:00100000:1.0:1789024119.270209:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363008 00000100:00100000:1.0:1789024119.270280:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:1.0:1789024119.270292:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+44:2403:x1875927402363008:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024119.270324:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024119.270350:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4180 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6bc expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.270371:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024119.270377:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024119.270443:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+43:2403:x1875927402363008:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 154us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024119.270451:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:2.0:1789024119.331111:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.331293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363264 00000100:00100000:3.0:1789024119.331303:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363264 00000100:00100000:3.0:1789024119.331361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 167 00000100:00100000:3.0:1789024119.331372:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12278:x1875927402363264:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:3.0:1789024119.331397:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024119.331400:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789024119.331428:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb40e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af692 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331467:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024119.331472:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024119.331485:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb418e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6c3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331596:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331610:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331618:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331650:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.331675:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 43 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024119.331690:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03941180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422349440:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024119.331798:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024119.337270:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.337431:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03941180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422349440:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024119.337463:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024119.337539:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363392 00000100:00100000:0.0:1789024119.337548:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363392 00010000:00010000:0.0:1789024119.337589:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 44 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024119.337630:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 82 00000100:00100000:0.0:1789024119.337811:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+44:2403:x1875927402363392:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024119.337826:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024119.337833:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 44 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337845:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 44 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337880:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb4164 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6b5 expref: 44 pid: 6516 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337896:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024119.337900:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337920:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337928:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.337960:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024119.338125:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.338139:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024119.338179:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789024119.338324:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb418e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.338340:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.338347:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024119.338350:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024119.338352:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00100000:0.0:1789024119.338440:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+44:2403:x1875927402363392:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 800us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024119.338449:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 82 00000100:00100000:3.0:1789024119.339477:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12278:x1875927402363264:12345-192.168.202.18@tcp:101:dd.0 Request processed in 8101us (8370us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789024119.339488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 167 00000100:00100000:0.0:1789024119.344255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.344345:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363520 00000100:00100000:3.0:1789024119.344354:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363520 00000100:00100000:3.0:1789024119.344445:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 168 00000100:00100000:3.0:1789024119.344456:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12278:x1875927402363520:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:3.0:1789024119.344481:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024119.344505:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb41a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6ca expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344543:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344572:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344585:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344778:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb41a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 45 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344796:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 44 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.344805:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024119.344807:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024119.344811:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4600, rc 0) 00000100:00100000:3.0:1789024119.345306:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+44:12278:x1875927402363520:12345-192.168.202.18@tcp:101:dd.0 Request processed in 848us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.345314:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 168 00000100:00100000:2.0:1789024119.349102:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024119.349203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363776 00000100:00100000:1.0:1789024119.349213:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363776 00000100:00100000:1.0:1789024119.349273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 169 00000100:00100000:1.0:1789024119.349283:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+44:12278:x1875927402363776:12345-192.168.202.18@tcp:36:dd.0 00010000:00010000:1.0:1789024119.349533:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.349553:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.349564:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024119.349605:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1789024119.349628:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c005225 reply state 00000000bf7a3b08 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.349664:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.349686:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024119.349688:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024119.349693:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024119.349800:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+47:12278:x1875927402363776:12345-192.168.202.18@tcp:36:dd.0 Request processed in 518us (708us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789024119.349808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 169 00000020:00080000:1.0:1789024119.349813:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789024119.636423:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.636517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402363904 00000100:00100000:3.0:1789024119.636528:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402363904 00000100:00100000:3.0:1789024119.636589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 170 00000100:00100000:3.0:1789024119.636600:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+47:12292:x1875927402363904:12345-192.168.202.18@tcp:101:stat.0 00010000:00010000:3.0:1789024119.636626:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024119.636667:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb41b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636738:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636765:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636776:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636788:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636795:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636801:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636886:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636897:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636907:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636941:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.636955:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 48 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024119.636981:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03941180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422349568:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024119.637776:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417600 going to sleep for 11 seconds 00000100:00100000:3.0:1789024119.639604:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03941180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422349568:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024119.639631:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024119.641370:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.641605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364160 00000100:00100000:3.0:1789024119.641616:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364160 00000100:00100000:3.0:1789024119.641686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:3.0:1789024119.641700:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+49:6172:x1875927402364160:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789024119.642285:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+50:6172:x1875927402364160:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 587us (923us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789024119.642294:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:2.0:1789024119.646623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024119.647225:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364288 00000100:00100000:1.0:1789024119.647236:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364288 00010000:00010000:1.0:1789024119.647276:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 50 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024119.647368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 83 00000100:00100000:1.0:1789024119.647379:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+50:2402:x1875927402364288:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024119.647395:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024119.647402:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 50 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647416:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 50 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647437:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb4195 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6c3 expref: 50 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647454:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024119.647459:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647486:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647494:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024119.647528:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024119.647586:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f194850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+49:2402:x1875927402364288:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 208us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024119.647593:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 83 00010000:00010000:3.0:1789024119.648490:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648501:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024119.648555:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789024119.648560:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024119.648585:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648600:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648622:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648629:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648662:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648669:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024119.648674:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648681:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648692:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024119.648695:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024119.648699:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648706:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb41bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648719:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648726:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648732:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648744:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024119.648748:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648754:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648763:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:3.0:1789024119.648766:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024119.648769:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648775:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb41c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648811:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb41b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d1 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648825:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d1 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.648831:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024119.648833:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024119.648835:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01488600, rc 0) 00000100:00100000:3.0:1789024119.649222:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+48:12292:x1875927402363904:12345-192.168.202.18@tcp:101:stat.0 Request processed in 12621us (12809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.649230:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 170 00000100:00100000:2.0:1789024119.694266:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422349952:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694472:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694542:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694600:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789024119.694607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422349824:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694627:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694645:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694695:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422350848:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694713:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.694748:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349952 00000100:00100000:2.0:1789024119.694756:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349952 00000100:00100000:2.0:1789024119.694799:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789024119.694808:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694863:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422349952:12345-0@lo:400:kworker.0 Request processed in 56us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.694870:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789024119.694894:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350976 00000100:00100000:2.0:1789024119.694898:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350976 00000100:00100000:2.0:1789024119.694922:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350848 00000100:00100000:2.0:1789024119.694925:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350848 00000100:00100000:2.0:1789024119.694952:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789024119.694958:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.694990:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422350976:12345-0@lo:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.694996:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789024119.695198:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789024119.695205:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422350848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695244:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422350848:12345-0@lo:400:kworker.0 Request processed in 40us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.695251:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789024119.695271:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350464 00000100:00100000:2.0:1789024119.695277:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350464 00000100:00100000:2.0:1789024119.695302:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349824 00000100:00100000:2.0:1789024119.695305:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349824 00000100:00100000:2.0:1789024119.695320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350336 00000100:00100000:2.0:1789024119.695322:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350336 00000100:00100000:2.0:1789024119.695333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789024119.695339:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422350464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695369:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875927422350464:12345-0@lo:400:kworker.0 Request processed in 30us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.695374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789024119.695386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789024119.695390:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695414:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422349824:12345-0@lo:400:kworker.0 Request processed in 24us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.695419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789024119.695429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789024119.695436:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422350336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695461:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422350336:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.695467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:2.0:1789024119.695488:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024119.695492:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024119.695494:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024119.695531:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422349824:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695550:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422350848:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695568:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422349952:0@lo:400:kworker.0 00010000:00080000:2.0:1789024119.695579:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc08780700 x1875927422350464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024119.695588:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875927422350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789024119.695597:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422350976:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.695830:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422349696:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.695873:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024119.695902:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422350208:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.695925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024119.695944:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422350720:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.695966:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024119.695986:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789024119.695993:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422350080:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696030:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024119.696046:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422350592:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696067:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024119.696090:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422349696 00000100:00100000:3.0:1789024119.696094:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422349696 00000100:00100000:3.0:1789024119.696123:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789024119.696130:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696183:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422349696:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.696189:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789024119.696214:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350208 00000100:00100000:3.0:1789024119.696218:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350208 00000100:00100000:3.0:1789024119.696242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789024119.696248:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696278:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422350208:12345-0@lo:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.696284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789024119.696309:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422349696:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422350208:0@lo:400:kworker.0 00010000:00010000:3.0:1789024119.696388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024119.696398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350720 00000100:00100000:3.0:1789024119.696402:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350720 00000100:00100000:3.0:1789024119.696425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350080 00000100:00100000:3.0:1789024119.696427:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350080 00000100:00100000:3.0:1789024119.696436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422350592 00000100:00100000:3.0:1789024119.696438:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422350592 00000100:00100000:3.0:1789024119.696450:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789024119.696455:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422350720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696485:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422350720:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.696490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789024119.696502:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789024119.696507:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696533:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb02601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422350080:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.696538:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789024119.696549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789024119.696555:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422350592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696581:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422350592:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.696586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789024119.696610:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422350080:0@lo:400:kworker.0 00000100:00100000:3.0:1789024119.696618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422350592:0@lo:400:kworker.0 00010000:00080000:3.0:1789024119.696637:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf35f80 x1875927422350720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024119.696646:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422350720:0@lo:400:kworker.0 00000100:00080000:3.0:1789024119.696675:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024119.696677:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024119.697029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024119.697062:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024119.697103:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422351104 00000100:00100000:0.0:1789024119.697106:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422351104 00000100:00100000:0.0:1789024119.697130:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789024119.697136:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789024119.697167:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789024119.697196:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f975c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024119.697202:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789024119.697228:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024119.698122:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024119.698133:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422351232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024119.698197:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024119.698326:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422351232 00000100:00100000:2.0:1789024119.698332:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422351232 00000100:00100000:2.0:1789024119.698367:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789024119.698374:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422351232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024119.698387:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024119.698427:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422351232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.698433:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789024119.698503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422351232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024119.735373:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.735465:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364544 00000100:00100000:3.0:1789024119.735476:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364544 00000100:00100000:3.0:1789024119.735547:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 171 00000100:00100000:3.0:1789024119.735558:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+48:12298:x1875927402364544:12345-192.168.202.18@tcp:36:truncate.0 00010000:00010000:3.0:1789024119.735611:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024119.735639:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb41cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d1 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.735690:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024119.735695:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024119.735875:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.735890:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.735900:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789024119.735955:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789024119.735978:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000117b502 reply state 000000007ab895ca transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.735990:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024119.736365:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024119.736368:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024119.736371:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024119.736589:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+50:12298:x1875927402364544:12345-192.168.202.18@tcp:36:truncate.0 Request processed in 1030us (1222us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789024119.736597:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 171 00000020:00080000:3.0:1789024119.736602:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789024119.830349:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024119.830457:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364672 00000100:00100000:1.0:1789024119.830468:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364672 00000100:00100000:1.0:1789024119.830529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 392 00000100:00100000:1.0:1789024119.830539:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402364672:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024119.830615:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402364672:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024119.830623:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 392 00000100:00100000:1.0:1789024119.838975:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024119.843157:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364800 00000100:00100000:2.0:1789024119.843175:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364800 00000100:00100000:2.0:1789024119.843275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 337 00000100:00100000:2.0:1789024119.843287:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402364800:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024119.843385:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402364800:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 100us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024119.843410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 337 00000100:00080000:3.0:1789024119.843560:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024119.850322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024119.850432:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024119.850907:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365312 00000100:00100000:0.0:1789024119.850931:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365312 00000100:00100000:0.0:1789024119.851017:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 338 00000100:00100000:0.0:1789024119.851029:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402365312:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024119.851109:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402365312:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 82us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024119.851116:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 338 00000100:00080000:2.0:1789024119.851570:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024119.852246:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365056 00000100:00100000:3.0:1789024119.852255:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365056 00000100:00100000:3.0:1789024119.852312:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:3.0:1789024119.852321:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc35735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402365056:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024119.852386:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc35735050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402365056:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 66us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.852392:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:2.0:1789024119.860533:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024119.860584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024119.860688:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365184 00000100:00100000:3.0:1789024119.860700:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365184 00000100:00100000:3.0:1789024119.860781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 339 00000100:00100000:3.0:1789024119.860792:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402365184:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024119.860885:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402365184:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024119.860892:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 339 00000100:00080000:2.0:1789024119.861371:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024119.861791:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402364928 00000100:00100000:0.0:1789024119.861799:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402364928 00000100:00100000:0.0:1789024119.861863:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 102 00000100:00100000:0.0:1789024119.861871:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402364928:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024119.861925:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2402:x1875927402364928:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 55us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024119.861932:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 102 00000100:00080000:2.0:1789024119.862518:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024119.955599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024119.955715:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365440 00000100:00100000:0.0:1789024119.955728:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365440 00000100:00100000:0.0:1789024119.955793:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 172 00000100:00100000:0.0:1789024119.955804:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+50:12312:x1875927402365440:12345-192.168.202.18@tcp:101:stat.0 00010000:00010000:0.0:1789024119.955829:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024119.955861:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb41db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6d8 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955929:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955943:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955954:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955981:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955988:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.955996:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956083:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956093:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956099:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024119.956143:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789024119.956184:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024119.956205:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956218:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956227:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956234:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956253:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956259:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ec00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024119.956264:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956271:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956282:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024119.956284:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024119.956289:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956294:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb41e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956307:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956313:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956318:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956322:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024119.956325:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956340:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956348:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:0.0:1789024119.956350:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024119.956354:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956360:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb41e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956388:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb41db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 52 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956402:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 51 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024119.956410:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024119.956412:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024119.956414:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024119.956482:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+51:12312:x1875927402365440:12345-192.168.202.18@tcp:101:stat.0 Request processed in 680us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024119.956489:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 172 00000100:00100000:3.0:1789024120.151666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.151825:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365696 00000100:00100000:0.0:1789024120.151836:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365696 00000100:00100000:0.0:1789024120.151928:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 173 00000100:00100000:0.0:1789024120.151939:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+51:12322:x1875927402365696:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024120.151977:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024120.152002:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb41f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6df expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024120.152126:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789024120.152265:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb41f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6df expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.152280:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:0.0:1789024120.152283:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024120.152288:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb41f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6df expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.152301:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ea00, rc 0) 00000100:00100000:0.0:1789024120.152364:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+52:12322:x1875927402365696:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 428us (724us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1789024120.152372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 173 00000100:00080000:2.0:1789024120.152969:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024120.169672:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.169802:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402365952 00000100:00100000:2.0:1789024120.169813:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402365952 00000100:00100000:2.0:1789024120.169884:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:2.0:1789024120.169894:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+52:12322:x1875927402365952:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024120.170398:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+53:12322:x1875927402365952:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 503us (733us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789024120.170406:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:1.0:1789024120.268528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.268631:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402366208 00000100:00100000:2.0:1789024120.268658:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402366208 00000100:00100000:2.0:1789024120.268723:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 174 00000100:00100000:2.0:1789024120.268733:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+53:12328:x1875927402366208:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024120.268760:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024120.268781:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4205 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6e6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.268893:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.268920:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 54 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.268930:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.268964:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 54 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.268977:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 54 pid: 13818 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024120.268990:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422351360:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024120.270195:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789024120.273816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.274226:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402366336 00000100:00100000:0.0:1789024120.274236:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402366336 00010000:00010000:0.0:1789024120.274281:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 55 pid: 13818 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024120.274325:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 84 00000100:00100000:0.0:1789024120.274335:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+55:2402:x1875927402366336:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024120.274349:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024120.274355:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 55 pid: 13818 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.274387:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 55 pid: 13818 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.274411:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024120.274417:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.274428:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.274436:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.274457:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024120.274516:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+55:2402:x1875927402366336:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 182us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024120.274523:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 84 00010000:00010000:2.0:1789024120.275128:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb41f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6d8 expref: 54 pid: 13818 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024120.275194:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422351360:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024120.275217:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.275226:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.275231:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024120.275250:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789024120.275388:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4205 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.275406:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.275414:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:2.0:1789024120.275417:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789024120.275419:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:2.0:1789024120.275466:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+54:12328:x1875927402366208:12345-192.168.202.18@tcp:101:bash.0 Request processed in 6735us (6949us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789024120.275474:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 174 00000100:00100000:3.0:1789024120.278962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.279078:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402366592 00000100:00100000:2.0:1789024120.279089:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402366592 00000100:00100000:2.0:1789024120.279178:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 175 00000100:00100000:2.0:1789024120.279188:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+54:12328:x1875927402366592:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:2.0:1789024120.279422:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.279440:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.279451:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024120.279496:0:7824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789024120.279520:0:7824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3f90bdf reply state 00000000a1e20263 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.279532:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.279563:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:2.0:1789024120.279565:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024120.279569:0:7824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789024120.279669:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+57:12328:x1875927402366592:12345-192.168.202.18@tcp:36:bash.0 Request processed in 482us (716us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789024120.279676:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 175 00000020:00080000:2.0:1789024120.279681:0:7824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789024120.296544:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.296633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402366720 00000100:00100000:3.0:1789024120.296661:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402366720 00000100:00100000:3.0:1789024120.296723:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 176 00000100:00100000:3.0:1789024120.296733:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+57:12328:x1875927402366720:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024120.296760:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024120.296782:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4221 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6ed expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.296878:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.296894:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.296902:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.296938:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.296950:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 58 pid: 6515 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024120.296964:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875927422351488:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024120.297073:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417540 going to sleep for 11 seconds 00000100:00100000:3.0:1789024120.303407:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875927422351488:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024120.303436:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024120.305343:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024120.305483:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402366848 00000100:00100000:1.0:1789024120.305494:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402366848 00010000:00010000:1.0:1789024120.305535:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 59 pid: 6515 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024120.305579:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 85 00000100:00100000:1.0:1789024120.305589:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:2403:x1875927402366848:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024120.305615:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024120.305623:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 59 pid: 6515 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305635:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 59 pid: 6515 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305669:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb420c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6e6 expref: 59 pid: 6515 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305689:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024120.305694:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305704:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305711:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.305741:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024120.305884:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.305893:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024120.305945:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789024120.305950:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024120.305972:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.306008:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4221 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ed expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.306033:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ed expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.306041:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024120.306043:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024120.306046:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:1.0:1789024120.306252:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+58:2403:x1875927402366848:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 663us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024120.306261:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 85 00000100:00100000:3.0:1789024120.316456:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+57:12328:x1875927402366720:12345-192.168.202.18@tcp:101:bash.0 Request processed in 19712us (19911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.316469:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 176 00000100:00100000:1.0:1789024120.319861:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.320352:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402367104 00000100:00100000:0.0:1789024120.320363:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402367104 00000100:00100000:0.0:1789024120.320422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:0.0:1789024120.320433:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+57:12328:x1875927402367104:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:0.0:1789024120.320829:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12328:x1875927402367104:12345-192.168.202.18@tcp:35:bash.0 Request processed in 396us (975us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789024120.320838:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:2.0:1789024120.409600:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024120.409789:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402367360 00000100:00100000:1.0:1789024120.409799:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402367360 00000100:00100000:1.0:1789024120.409988:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 177 00000100:00100000:1.0:1789024120.410010:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12339:x1875927402367360:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024120.410050:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024120.410071:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb422f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6f4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024120.410201:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789024120.410300:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb422f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6f4 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.410314:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:1.0:1789024120.410317:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024120.410322:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb422f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6f4 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.410335:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322200, rc 0) 00000100:00100000:1.0:1789024120.410401:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12339:x1875927402367360:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 394us (813us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1789024120.410409:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 177 00000100:00100000:3.0:1789024120.414329:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.414473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402367488 00000100:00100000:0.0:1789024120.414497:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402367488 00000100:00100000:0.0:1789024120.414569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 178 00000100:00100000:0.0:1789024120.414580:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12339:x1875927402367488:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:0.0:1789024120.414671:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414687:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414699:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414718:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414724:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414794:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414804:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414811:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024120.414863:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414887:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414894:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414901:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414907:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.414911:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414919:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024120.414932:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.414937:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414943:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb423d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414956:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414962:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414968:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414980:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ec00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.414983:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.414989:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415009:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:0.0:1789024120.415012:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.415016:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415022:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4244 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415032:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415037:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415043:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415048:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.415051:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415057:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415074:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024120.415076:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.415078:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.415084:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb424b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024120.419248:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12339:x1875927402367488:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 4659us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024120.419261:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 178 00000100:00100000:3.0:1789024120.421810:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.421961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402367744 00000100:00100000:2.0:1789024120.421971:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402367744 00000100:00100000:2.0:1789024120.422044:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:2.0:1789024120.422055:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12339:x1875927402367744:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024120.422303:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+60:12339:x1875927402367744:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 249us (501us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789024120.422311:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:2.0:1789024120.449873:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.449955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368000 00000100:00100000:3.0:1789024120.449965:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368000 00000100:00100000:3.0:1789024120.450034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 179 00000100:00100000:3.0:1789024120.450058:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+60:12342:x1875927402368000:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024120.450082:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024120.450102:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4252 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af6fb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450220:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450236:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450246:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450258:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450265:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450272:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450377:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4267 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450388:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450395:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4267 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024120.450416:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789024120.450494:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450502:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450509:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450515:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024120.450520:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450527:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450538:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024120.450541:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024120.450545:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450550:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4259 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450563:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450569:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450585:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450590:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024120.450593:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450599:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450606:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:3.0:1789024120.450608:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024120.450612:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450618:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb4260 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450666:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb4252 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6fb expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450678:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4267 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6fb expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.450685:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024120.450686:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024120.450689:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161200, rc 0) 00000100:00100000:3.0:1789024120.450750:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+62:12342:x1875927402368000:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 693us (896us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789024120.450766:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 179 00000100:00100000:3.0:1789024120.454255:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024120.454411:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368128 00000100:00100000:1.0:1789024120.454423:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368128 00000100:00100000:1.0:1789024120.454485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 180 00000100:00100000:1.0:1789024120.454496:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+62:12342:x1875927402368128:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:1.0:1789024120.454569:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454587:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454598:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454662:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454670:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454678:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454684:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024120.454689:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454697:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454709:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024120.454713:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024120.454718:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.454724:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb4275 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024120.455105:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+62:12342:x1875927402368128:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 610us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024120.455113:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 180 00000100:00100000:0.0:1789024120.461314:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.461378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368384 00000100:00100000:3.0:1789024120.461386:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368384 00000100:00100000:3.0:1789024120.461430:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:3.0:1789024120.461437:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+62:12342:x1875927402368384:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024120.461633:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12342:x1875927402368384:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 195us (324us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789024120.461654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:0.0:1789024120.467871:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.467949:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368512 00000100:00100000:3.0:1789024120.467960:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368512 00000100:00100000:3.0:1789024120.468040:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:3.0:1789024120.468052:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+63:2400:x1875927402368512:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024120.468069:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024120.468095:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4267 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6fb expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.468115:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024120.468121:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024120.468208:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+62:2400:x1875927402368512:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 158us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.468216:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:3.0:1789024120.606908:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.607198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368768 00000100:00100000:0.0:1789024120.607209:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368768 00000100:00100000:0.0:1789024120.607274:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:0.0:1789024120.607284:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+62:12360:x1875927402368768:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:0.0:1789024120.607309:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024120.607330:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb427c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af702 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.607434:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4283 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.607450:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4283 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.607462:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4283 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024120.607490:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789024120.607597:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb427c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af702 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.607616:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4283 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af702 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.607625:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024120.607628:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789024120.607631:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f600, rc 0) 00000100:00100000:0.0:1789024120.607721:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12360:x1875927402368768:12345-192.168.202.18@tcp:101:cat.0 Request processed in 439us (822us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789024120.607728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 181 00000100:00100000:1.0:1789024120.635830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.635922:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402368896 00000100:00100000:2.0:1789024120.635932:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402368896 00000100:00100000:2.0:1789024120.636003:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:2.0:1789024120.636015:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12361:x1875927402368896:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024120.636040:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024120.636062:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af709 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636127:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636189:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636200:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024120.636239:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789024120.636243:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024120.636259:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636284:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af709 expref: 66 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636301:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af709 expref: 65 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.636310:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024120.636312:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024120.636316:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4200, rc 0) 00000100:00100000:2.0:1789024120.636373:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12361:x1875927402368896:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 361us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024120.636380:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 182 00000100:00100000:2.0:1789024120.641732:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.641875:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369280 00000100:00100000:3.0:1789024120.641887:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369280 00000100:00100000:3.0:1789024120.641958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 48 00000100:00100000:3.0:1789024120.641969:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12361:x1875927402369280:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024120.642306:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12361:x1875927402369280:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 339us (585us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789024120.642314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 48 00000100:00100000:3.0:1789024120.644666:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.645284:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369408 00000100:00100000:0.0:1789024120.645294:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369408 00000100:00100000:0.0:1789024120.645413:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:0.0:1789024120.645436:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12361:x1875927402369408:12345-192.168.202.18@tcp:103:lfs.0 00010000:00010000:0.0:1789024120.645451:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789024120.645477:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ed expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.645500:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4283 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af702 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.645514:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4125 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6a7 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.645544:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024120.645549:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024120.645612:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12361:x1875927402369408:12345-192.168.202.18@tcp:103:lfs.0 Request processed in 189us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024120.645621:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:2.0:1789024120.648224:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.648454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369536 00000100:00100000:3.0:1789024120.648465:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369536 00000100:00100000:3.0:1789024120.648528:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 183 00000100:00100000:3.0:1789024120.648537:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12361:x1875927402369536:12345-192.168.202.18@tcp:58:lfs.0 00010000:00010000:3.0:1789024120.648696:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.648713:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.648726:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024120.648876:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789024120.648961:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12361:x1875927402369536:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 425us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.648969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 183 00000100:00100000:2.0:1789024120.669878:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.670020:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369664 00000100:00100000:3.0:1789024120.670030:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369664 00000100:00100000:3.0:1789024120.670089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 184 00000100:00100000:3.0:1789024120.670097:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12363:x1875927402369664:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024120.670114:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024120.670140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb42a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af710 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670234:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670246:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670254:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670261:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670265:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670269:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670324:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670330:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670333:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024120.670367:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789024120.670370:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024120.670383:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670398:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670403:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670407:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670412:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670415:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024120.670418:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670422:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670430:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024120.670432:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024120.670435:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670439:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160000/0xa736ef4b98cb42ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670446:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670450:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670457:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670461:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024120.670462:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670466:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670470:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:3.0:1789024120.670471:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024120.670473:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670476:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb42b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670496:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb42a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670509:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.670515:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024120.670517:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024120.670519:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:3.0:1789024120.670583:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12363:x1875927402369664:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 486us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.670597:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 184 00010000:00010000:2.0:1789024120.716380:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789024120.908928:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789024120.908938:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024120.908972:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789024120.908979:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789024120.909110:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422351616:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024120.909234:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789024120.925727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.926230:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369792 00000100:00100000:0.0:1789024120.926241:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369792 00000100:00100000:0.0:1789024120.926305:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 185 00000100:00100000:0.0:1789024120.926316:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402369792:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789024120.926348:0:13818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789024120.926484:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402369792:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 170us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024120.926492:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 185 00000100:00100000:1.0:1789024120.931615:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422351616:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789024120.934137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024120.934333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402369920 00000100:00100000:0.0:1789024120.934344:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402369920 00000100:00100000:0.0:1789024120.934420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 186 00000100:00100000:0.0:1789024120.934431:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12374:x1875927402369920:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789024120.934505:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934524:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934536:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934628:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934652:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934660:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934691:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934701:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934708:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024120.934754:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789024120.934758:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024120.934770:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934783:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934791:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934798:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934814:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ec00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.934819:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934827:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934839:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:0.0:1789024120.934843:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.934848:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934855:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb42c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934869:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934875:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934881:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934886:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.934889:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934896:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934913:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff90cc11d52000) 00010000:00010000:0.0:1789024120.934916:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.934919:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934925:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb42c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934941:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934947:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934952:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934958:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024120.934961:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934967:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934974:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024120.934976:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024120.934979:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024120.934984:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb42d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024120.935072:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12374:x1875927402369920:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 Request processed in 642us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024120.935080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 186 00000100:00100000:0.0:1789024120.941848:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024120.942119:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402370176 00000100:00100000:1.0:1789024120.942131:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402370176 00000100:00100000:1.0:1789024120.942216:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 187 00000100:00100000:1.0:1789024120.942227:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12374:x1875927402370176:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024120.942249:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024120.942271:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb42d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af717 expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942379:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942405:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942417:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024120.942429:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789024120.942507:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942515:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942521:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942541:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024120.942546:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942553:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942565:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024120.942568:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789024120.942573:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942580:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb42de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942621:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb42d7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af717 expref: 66 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.942632:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:1.0:1789024120.942634:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024120.943068:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb42d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af717 expref: 66 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024120.943082:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323c00, rc 0) 00000100:00100000:1.0:1789024120.943179:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370176:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 953us (1340us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789024120.943187:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 187 00000100:00100000:0.0:1789024120.952794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.952869:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402370304 00000100:00100000:3.0:1789024120.952880:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402370304 00000100:00100000:3.0:1789024120.952937:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 188 00000100:00100000:3.0:1789024120.952948:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370304:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789024120.952982:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789024120.954924:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370304:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 1970us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.954935:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 188 00000100:00100000:0.0:1789024120.970233:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.970422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402370560 00000100:00100000:3.0:1789024120.970432:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402370560 00000100:00100000:3.0:1789024120.970496:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:3.0:1789024120.970507:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370560:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024120.970528:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024120.970531:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789024120.970560:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4298 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af709 expref: 65 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.970582:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024120.970587:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024120.970600:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb42ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af71e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024120.971533:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789024120.971710:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb42f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.971733:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.971743:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.971800:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4a00/0xa736ef4b98cb42ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af71e expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.971816:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb42f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af71e expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.971823:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ab00) 00010000:00010000:3.0:1789024120.971825:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024120.971828:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4c00, rc 0) 00000100:00100000:3.0:1789024120.971909:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12374:x1875927402370560:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1404us (1687us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789024120.971918:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 189 00000100:00100000:0.0:1789024120.982501:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024120.982706:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402370816 00000100:00100000:2.0:1789024120.982717:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402370816 00000100:00100000:2.0:1789024120.982787:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:2.0:1789024120.982798:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12374:x1875927402370816:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789024120.982856:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024120.982889:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb42f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af71e expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.982909:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ab00) 00010000:00010000:2.0:1789024120.982919:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789024120.982941:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.982956:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.982968:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.982984:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983004:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983011:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983061:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983091:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983097:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983103:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024120.983107:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983114:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983123:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024120.983125:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024120.983129:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983134:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4301 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983186:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983192:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983197:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983202:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024120.983210:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983217:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983225:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x81d232ea (ffff90cc41bc7000) 00010000:00010000:2.0:1789024120.983227:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024120.983230:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024120.983236:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4308 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x81d232ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024120.983317:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370816:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 520us (825us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789024120.983325:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 190 00000100:00100000:0.0:1789024120.986752:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024120.986877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402370944 00000100:00100000:3.0:1789024120.986888:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402370944 00000100:00100000:3.0:1789024120.986952:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:3.0:1789024120.986963:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12374:x1875927402370944:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024120.986984:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024120.987020:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb430f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af725 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987055:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987081:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987092:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987568:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb430f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987589:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024120.987596:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024120.987599:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024120.987602:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160400, rc 0) 00000100:00100000:3.0:1789024120.987727:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12374:x1875927402370944:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 766us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024120.987734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 191 00000100:00100000:2.0:1789024121.022803:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.023120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402371200 00000100:00100000:3.0:1789024121.023137:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402371200 00000100:00100000:3.0:1789024121.023255:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00100000:3.0:1789024121.023266:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12374:x1875927402371200:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789024121.023390:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.023408:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.023437:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024121.025752:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789024121.025793:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439061645135ns, next at 440061638492ns, rc = 0 00000004:00010000:3.0:1789024121.025902:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002821976a reply state 000000008a198766 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.025928:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.025938:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024121.025940:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789024121.025945:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024121.026094:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12374:x1875927402371200:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 2824us (3296us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789024121.026106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 192 00000100:00100000:0.0:1789024121.029265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.029411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402371328 00000100:00100000:3.0:1789024121.029424:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402371328 00000100:00100000:3.0:1789024121.029485:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 193 00000100:00100000:3.0:1789024121.029494:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12374:x1875927402371328:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024121.029525:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024121.029576:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af72c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.029660:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.029692:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.029718:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024121.029722:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024121.029726:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338b200, rc 0) 00000100:00100000:3.0:1789024121.029817:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+69:12374:x1875927402371328:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 323us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.029825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 193 00000100:00100000:0.0:1789024121.032393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.032512:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402371456 00000100:00100000:2.0:1789024121.032531:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402371456 00000100:00080000:3.0:1789024121.032613:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024121.032652:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024121.032667:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+6:2403:x1875927402371456:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789024121.032898:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402371456:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 235us (518us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789024121.032907:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024121.039609:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.039737:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402371712 00000100:00100000:1.0:1789024121.039760:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402371712 00000100:00100000:1.0:1789024121.039829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:1.0:1789024121.039842:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+69:12374:x1875927402371712:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789024121.040108:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12374:x1875927402371712:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 269us (509us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789024121.040118:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:3.0:1789024121.044757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.044804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402371968 00000100:00100000:3.0:1789024121.044818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402371968 00000100:00100000:3.0:1789024121.044889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 194 00000100:00100000:3.0:1789024121.044903:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12374:x1875927402371968:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789024121.045049:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12374:x1875927402371968:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.045055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 194 00000100:00100000:0.0:1789024121.049031:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.049494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372096 00000100:00100000:3.0:1789024121.049510:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372096 00000100:00100000:3.0:1789024121.049578:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 195 00000100:00100000:3.0:1789024121.049596:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12374:x1875927402372096:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024121.049618:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024121.049650:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a600/0xa736ef4b98cb432b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af733 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049740:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049757:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049769:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024121.049814:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024121.049833:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049860:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a600/0xa736ef4b98cb432b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af733 expref: 72 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049876:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af733 expref: 71 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.049884:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024121.049887:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789024121.049891:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338ac00, rc 0) 00000100:00100000:3.0:1789024121.049963:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12374:x1875927402372096:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 375us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.049973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 195 00000100:00100000:2.0:1789024121.065435:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.065595:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372224 00000100:00100000:1.0:1789024121.065607:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372224 00000100:00100000:1.0:1789024121.065682:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:1.0:1789024121.065693:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402372224:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024121.065711:0:8904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024121.065735:0:8904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af73a expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024121.065766:0:8904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa25779, blocks: 0x0 00010000:00010000:1.0:1789024121.065790:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789024121.065795:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024121.065805:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 8 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.065827:0:8904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 8 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.065842:0:8904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323c00, rc 0) 00000100:00100000:1.0:1789024121.065913:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402372224:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 221us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024121.065940:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:0.0:1789024121.071360:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.071535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372480 00000100:00100000:3.0:1789024121.071560:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372480 00000100:00100000:3.0:1789024121.071630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 196 00000100:00100000:3.0:1789024121.071668:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12374:x1875927402372480:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789024121.071791:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12374:x1875927402372480:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 127us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.071799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 196 00000100:00100000:2.0:1789024121.074720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.074813:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372608 00000100:00100000:1.0:1789024121.074823:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372608 00000100:00100000:1.0:1789024121.074880:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:1.0:1789024121.074890:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:12374:x1875927402372608:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024121.074907:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024121.074925:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af741 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.074958:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 9 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.074966:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024121.074971:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024121.074976:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.075008:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 9 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.075022:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 9 pid: 8904 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024121.075036:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422351744:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024121.075122:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024121.081427:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.081471:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372736 00000100:00100000:2.0:1789024121.081481:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372736 00010000:00010000:2.0:1789024121.081522:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 10 pid: 8904 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.081562:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 86 00000100:00100000:2.0:1789024121.081573:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2403:x1875927402372736:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024121.081589:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024121.081613:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 10 pid: 8904 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.081627:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 10 pid: 8904 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.081663:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024121.081668:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024121.081677:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.081689:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.081729:0:7924:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.081744:0:7924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7924:1875927422351872:192.168.202.18@tcp:105: 00000100:00100000:2.0:1789024121.081829:0:7924:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789024121.083112:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4339 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af73a expref: 10 pid: 8904 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.083133:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422351744:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024121.083199:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.083212:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322a00, rc 0) 00000100:00100000:3.0:1789024121.083277:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3c025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:12374:x1875927402372608:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 8388us (8565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.083287:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:3.0:1789024121.086002:0:7924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7924:1875927422351872:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024121.086029:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024121.086086:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402372736:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 4514us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.086096:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 86 00000100:00100000:2.0:1789024121.087594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.087694:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372864 00000100:00100000:3.0:1789024121.087713:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372864 00002000:00100000:3.0:1789024121.088009:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90cc3bf96300 x1875927402372864/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:292/0 lens 504/0 e 0 to 0 dl 1789024132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789024121.088046:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3bf96300 with x1875927402372864 ext(0->8) 00002000:00010000:3.0:1789024121.088055:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3bf96300 00000100:00100000:3.0:1789024121.088098:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:3.0:1789024121.088107:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402372864:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789024121.092133:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402372864:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 Request processed in 4013us (4534us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789024121.092166:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00002000:00100000:3.0:1789024121.092180:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90cc3bf96300 x1875927402372864/t4294967315(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:292/0 lens 504/448 e 0 to 0 dl 1789024132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789024121.092192:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3bf96300 with x1875927402372864 ext(0->8) 00002000:00010000:3.0:1789024121.092200:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3bf96300 00000100:00100000:3.0:1789024121.094820:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.095006:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402372992 00000100:00100000:0.0:1789024121.095017:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402372992 00000100:00100000:0.0:1789024121.095134:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 197 00000100:00100000:0.0:1789024121.095421:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12374:x1875927402372992:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789024121.099015:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1789024121.099032:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1789024121.099099:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789024121.099121:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cb039d9f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789024121.099127:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc35430100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cb039d96c0 00000020:00080000:3.0:1789024121.099131:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc35430a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cb030b1400 00010000:00010000:0.0:1789024121.099434:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099448:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099456:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099462:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.099466:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099491:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099506:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90cb0231a600) 00010000:00010000:0.0:1789024121.099508:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.099513:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099520:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4068 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099538:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099545:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099550:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099555:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.099558:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099564:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099571:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024121.099573:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.099577:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099593:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488800/0xa736ef4b98cb406f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099611:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099617:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099623:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.099628:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5e00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.099631:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102855:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102878:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7f00) 00010000:00010000:0.0:1789024121.102882:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.102888:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102897:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb40ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102937:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102945:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102963:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102970:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.102973:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102980:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.102989:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024121.102992:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.102995:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103001:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb41b1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103013:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103019:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103025:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103031:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.103034:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103051:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103059:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024121.103061:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.103064:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103069:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4200/0xa736ef4b98cb41d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103080:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103086:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103091:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103096:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.103099:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103105:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103112:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:0.0:1789024121.103114:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024121.103116:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103133:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb421a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103167:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103174:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103180:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103185:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024121.103188:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103194:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103202:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:0.0:1789024121.103204:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789024121.103217:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.103224:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01488600/0xa736ef4b98cb431d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789024121.103344:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789024121.103409:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789024121.104886:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024121.104910:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422352000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789024121.104980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024121.105042:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422352000 00000100:00100000:0.0:1789024121.105050:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422352000 00000100:00100000:0.0:1789024121.105102:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789024121.105112:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422352000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789024121.106059:0:10202:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789024121.106063:0:10202:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789024121 00002000:00010000:0.0:1789024121.106066:0:10202:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789024121.106068:0:10202:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789024121 -> 1789024121 00002000:00010000:0.0:1789024121.106071:0:10202:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789024121.106124:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422352000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1014us (1143us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789024121.106132:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789024121.106181:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789024121.106231:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cc3fae1500/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789024121.106305:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422352000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789024121.106427:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+19:12374:x1875927402372992:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 Request processed in 11282us (11615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024121.106435:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 197 00000100:00100000:3.0:1789024121.106858:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024121.106870:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb021e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422352128:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789024121.106912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024121.107580:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422352128 00000100:00100000:0.0:1789024121.107587:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422352128 00000100:00080000:3.0:1789024121.107658:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024121.108534:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789024121.108546:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875927422352128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789024121.108578:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1789024121.108612:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa25776, atime: 0x6aa25777, ctime: 0x6aa25776, blocks: 0x8 00010000:00010000:0.0:1789024121.108620:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.108662:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=439s v=(0 0) 00010000:00010000:0.0:1789024121.108667:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024121.108673:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.108691:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.108702:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.108710:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.108733:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024121.108791:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024121.108800:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.108810:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ee00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024121.108815:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.108826:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.108846:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.108854:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f0387e1/0xa736ef4b98cb4347 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.108875:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024121.108877:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024121.108879:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024121.108929:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb021e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422352128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 385us (2015us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789024121.108937:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1789024121.109020:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb021e1880/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789024121.109028:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb021e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422352128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789024121.115713:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.130135:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402373120 00000100:00100000:0.0:1789024121.130379:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402373120 00000100:00100000:1.0:1789024121.131263:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:1.0:1789024121.131276:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402373120:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789024121.133130:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1789024121.133184:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789024121.133364:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402373120:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 Request processed in 2081us (17648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.133377:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:3.0:1789024121.138191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.138400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402373376 00000100:00100000:1.0:1789024121.138423:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402373376 00000100:00100000:1.0:1789024121.138535:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 198 00000100:00100000:1.0:1789024121.138551:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:12374:x1875927402373376:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024121.138649:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024121.138692:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ac00/0xa736ef4b98cb4332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af733 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.138719:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:1.0:1789024121.138725:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024121.138950:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.138971:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.138984:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024121.139229:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d2197e reply state 000000007a0841c9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.139242:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.139263:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:1.0:1789024121.139265:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024121.139268:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024121.139422:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:12374:x1875927402373376:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 875us (1244us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789024121.139429:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 198 00000100:00100000:1.0:1789024121.142391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.142472:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402373504 00000100:00100000:0.0:1789024121.142489:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402373504 00000100:00100000:0.0:1789024121.142564:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:0.0:1789024121.142580:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402373504:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789024121.142829:0:8904:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789024121.142833:0:8904:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789024121 -> 1789024120 00002000:00010000:0.0:1789024121.142842:0:8904:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789024119 00002000:00010000:0.0:1789024121.142843:0:8904:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789024121 -> 1789024120 00002000:00010000:0.0:1789024121.142845:0:8904:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789024121.142917:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402373504:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 341us (541us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789024121.142926:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:3.0:1789024121.145321:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.145903:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402373760 00000100:00100000:0.0:1789024121.145920:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402373760 00000100:00100000:0.0:1789024121.145995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:0.0:1789024121.146007:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+20:12374:x1875927402373760:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789024121.146077:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.146095:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.146104:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.146139:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.146177:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 20 pid: 6515 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024121.146195:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422352256:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024121.152111:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908900 going to sleep for 11 seconds 00000100:00100000:1.0:1789024121.155543:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422352256:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024121.155578:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.161765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.161846:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402373888 00000100:00100000:0.0:1789024121.161862:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402373888 00010000:00010000:0.0:1789024121.161927:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 21 pid: 6515 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024121.161981:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 87 00000100:00100000:0.0:1789024121.161992:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+21:2402:x1875927402373888:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024121.162007:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024121.162014:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 21 pid: 6515 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162029:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 21 pid: 6515 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162055:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160400/0xa736ef4b98cb4316 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af725 expref: 21 pid: 6515 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162076:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:0.0:1789024121.162081:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162091:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162099:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.162131:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024121.162334:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:2402:x1875927402373888:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 344us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024121.162342:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 87 00010000:00010000:3.0:1789024121.165119:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165206:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165264:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165275:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165284:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165292:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ea00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.165297:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165305:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165326:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024121.165329:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789024121.165334:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.165340:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4355 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.165458:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:12374:x1875927402373760:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 Request processed in 19446us (20143us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789024121.165478:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 199 00000100:00100000:3.0:1789024121.184122:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.184199:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374016 00000100:00100000:3.0:1789024121.184209:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374016 00000100:00100000:3.0:1789024121.184261:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:3.0:1789024121.184269:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402374016:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789024121.184320:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.184343:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.184354:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024121.184360:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789024121.184366:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.184415:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.184431:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 8 pid: 8431 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.184449:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03940380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422352384:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024121.184543:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024121.188658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.188710:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374144 00000100:00100000:2.0:1789024121.188720:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374144 00000100:00100000:3.0:1789024121.188735:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03940380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875927422352384:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024121.188774:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.188885:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.188940:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 88 00000100:00100000:2.0:1789024121.188953:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc0f194050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2403:x1875927402374144:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024121.188972:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024121.189003:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189019:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189049:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af741 expref: 9 pid: 8431 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189068:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024121.189073:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789024121.189081:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189093:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189129:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024121.189206:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc0f194050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402374144:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 256us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.189212:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 88 00010000:00010000:2.0:1789024121.189366:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189374:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189394:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189400:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189407:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189412:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024121.189415:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189421:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189440:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.189446:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b19998/0xa736ef4b98cb435c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.189818:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402374016:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 Request processed in 5547us (5706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.189829:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:3.0:1789024121.197025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.201709:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374400 00000100:00100000:0.0:1789024121.201726:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374400 00000100:00100000:0.0:1789024121.201809:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 200 00000100:00100000:0.0:1789024121.201821:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+19:12374:x1875927402374400:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789024121.201931:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.201954:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 19 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.201966:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.202016:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 19 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.202033:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 19 pid: 7824 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024121.202053:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422352512:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024121.202219:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb03908900 going to sleep for 11 seconds 00000100:00100000:1.0:1789024121.210949:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422352512:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024121.211535:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024121.211804:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.211840:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374528 00000100:00100000:1.0:1789024121.211849:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374528 00010000:00010000:1.0:1789024121.211919:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 20 pid: 7824 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024121.211967:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 89 00000100:00100000:1.0:1789024121.211979:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:2402:x1875927402374528:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024121.212006:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024121.212018:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 20 pid: 7824 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212045:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 20 pid: 7824 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212079:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb41aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af6ca expref: 20 pid: 7824 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212098:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:1.0:1789024121.212104:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212118:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212129:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212255:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024121.212332:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:2402:x1875927402374528:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 354us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024121.212341:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 89 00010000:00010000:1.0:1789024121.212473:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212481:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212719:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212745:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212755:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212798:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.212814:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 19 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024121.212830:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422352640:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024121.212911:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1004f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789024121.224905:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.224950:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422352640:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024121.225090:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374656 00000100:00100000:3.0:1789024121.225100:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374656 00010000:00010000:3.0:1789024121.225174:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 20 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.225222:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 90 00000100:00100000:3.0:1789024121.225235:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+20:2400:x1875927402374656:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024121.225254:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024121.225263:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 20 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225277:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 20 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225304:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4324 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af72c expref: 20 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225448:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:3.0:1789024121.225454:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225467:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225486:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.225509:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024121.225581:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:2400:x1875927402374656:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 348us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.225589:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 90 00010000:00010000:2.0:1789024121.225678:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.225689:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.225696:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024121.225848:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789024121.228590:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789024121.228734:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422352768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024121.228828:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024121.228877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422352768 00000100:00100000:0.0:1789024121.228889:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422352768 00000100:00100000:0.0:1789024121.229020:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789024121.229031:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422352768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024121.229071:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000001:00080000:2.0:1789024121.229073:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789024121.229132:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422352768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.229186:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422352896:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789024121.229194:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422352768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024121.229228:0:13818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024121.229262:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789024121.232338:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422352896 00000100:00100000:1.0:1789024121.232360:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422352896 00000100:00100000:1.0:1789024121.232417:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789024121.232427:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422352896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789024121.232712:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422352896:12345-0@lo:1000:mdt00_004.0 Request processed in 240us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024121.232722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789024121.239357:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024121.239414:0:13818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789024121.239422:0:13818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cc3fae1500, transno 4294967316 00000100:00100000:2.0:1789024121.244517:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422352896:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789024121.244757:0:13818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789024121.244855:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422353024:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789024121.244956:0:13818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024121.245000:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024121.245284:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422353024 00000100:00100000:1.0:1789024121.245296:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422353024 00000100:00100000:1.0:1789024121.245368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789024121.245390:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13818:x1875927422353024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789024121.245579:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13818:x1875927422353024:12345-0@lo:1000:mdt00_004.0 Request processed in 192us (622us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789024121.245588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789024121.245961:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13818:1875927422353024:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789024121.246035:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246048:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246058:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246065:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024121.246071:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246080:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246106:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:2.0:1789024121.246109:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024121.246116:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246122:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323a00/0xa736ef4b98cb436a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246182:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246198:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246204:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246210:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024121.246213:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246220:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246231:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:2.0:1789024121.246234:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789024121.246237:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246243:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb429f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246271:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246288:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246298:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246336:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.246359:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 22 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.246374:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422353152:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024121.246477:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024121.259902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.260452:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402374784 00000100:00100000:2.0:1789024121.260478:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402374784 00010000:00010000:2.0:1789024121.260538:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 23 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.260792:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422353152:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024121.260828:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.260944:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 91 00000100:00100000:2.0:1789024121.260958:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+23:2403:x1875927402374784:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024121.260978:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024121.262119:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 23 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262141:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 23 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262187:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb42bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af710 expref: 23 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262208:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:2.0:1789024121.262214:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262249:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262259:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.262295:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024121.262380:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2403:x1875927402374784:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 1424us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.262391:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 91 00010000:00010000:3.0:1789024121.262398:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262410:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262427:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262436:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262444:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262450:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.262463:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262472:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262545:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024121.262550:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.262555:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262562:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4371 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262627:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262643:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262649:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262655:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.262844:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262853:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262862:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cc41bc7d00) 00010000:00010000:3.0:1789024121.262865:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024121.262873:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.262899:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4363 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.263708:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12374:x1875927402374400:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 61885us (66692us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789024121.263720:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 200 00000020:00080000:3.0:1789024121.263725:0:13818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789024121.264406:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024121.264413:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024121.265430:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789024121.265445:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789024121.273883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024121.280190:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402375040 00000100:00100000:0.0:1789024121.280213:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402375040 00000100:00100000:2.0:1789024121.280378:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:2.0:1789024121.280392:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12374:x1875927402375040:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789024121.280787:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789024121.280833:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789024121.280902:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.280925:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.280941:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.280953:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.280960:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.280968:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.281013:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789024121.281386:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+23:12374:x1875927402375040:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 993us (7510us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789024121.281397:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 50 00000020:00080000:2.0:1789024121.281404:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789024121.281606:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024121.281615:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.281624:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024121.281629:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.281650:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.281668:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:1.0:1789024121.281671:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789024121.281678:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.281685:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4378 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.281700:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024121.281702:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024121.281704:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789024121.499518:0:14708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789024121.499527:0:14708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789024121.499562:0:14708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789024121.499571:0:14708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789024121.740290:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024121.787579:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.787744:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402375296 00000100:00100000:3.0:1789024121.787754:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402375296 00000100:00100000:3.0:1789024121.787815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:3.0:1789024121.787825:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+23:12384:x1875927402375296:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024121.787849:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024121.787869:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb437f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af748 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.787967:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ba00/0xa736ef4b98cb4386 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.787991:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ba00/0xa736ef4b98cb4386 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.788002:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ba00/0xa736ef4b98cb4386 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024121.788027:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789024121.788143:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb437f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af748 expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.788223:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ba00/0xa736ef4b98cb4386 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af748 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.788230:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024121.788233:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024121.788236:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338ba00, rc 0) 00000100:00100000:3.0:1789024121.788306:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12384:x1875927402375296:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 483us (738us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789024121.788314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 201 00000100:00100000:0.0:1789024121.793261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.793606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402375424 00000100:00100000:3.0:1789024121.793616:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402375424 00000100:00100000:3.0:1789024121.793689:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00100000:3.0:1789024121.793702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12384:x1875927402375424:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:3.0:1789024121.793779:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.793796:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.793807:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.793822:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.793843:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.793850:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794005:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794013:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794020:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024121.794570:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794587:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794594:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794600:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794606:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.794611:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794618:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794652:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024121.794655:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.794660:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794666:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4394 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794678:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794684:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794690:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794694:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.794697:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794702:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794709:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231b800) 00010000:00010000:3.0:1789024121.794712:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.794715:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794720:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb439b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794745:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794751:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794757:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794762:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ae00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.794764:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794770:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794778:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024121.794780:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.794782:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.794788:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.795997:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12384:x1875927402375424:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 2290us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024121.796010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 202 00000100:00100000:2.0:1789024121.847326:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.847418:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402375680 00000100:00100000:3.0:1789024121.847429:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402375680 00000100:00100000:3.0:1789024121.847510:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 203 00000100:00100000:3.0:1789024121.847535:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12387:x1875927402375680:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024121.847558:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024121.847578:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af74f expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847660:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847675:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847686:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847700:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847707:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847713:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847820:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847828:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847836:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024121.847870:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789024121.847947:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847955:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847961:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847968:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.847972:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.847990:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848003:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024121.848006:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.848012:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848019:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb43b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848033:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848039:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848056:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848063:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024121.848066:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848611:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848621:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024121.848623:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024121.848626:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848641:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb43b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848686:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 28 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848700:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 27 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.848707:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:3.0:1789024121.848709:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024121.848712:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338b000, rc 0) 00000100:00100000:3.0:1789024121.848770:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12387:x1875927402375680:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1238us (1456us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789024121.848788:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 203 00000100:00100000:1.0:1789024121.858500:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.858704:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402375808 00000100:00100000:2.0:1789024121.858715:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402375808 00000100:00100000:2.0:1789024121.858774:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 204 00000100:00100000:2.0:1789024121.858784:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12387:x1875927402375808:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:2.0:1789024121.858846:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858873:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858885:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858920:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858928:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858945:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858952:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024121.858956:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858965:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.858975:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024121.859252:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024121.859259:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.859266:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.859342:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12387:x1875927402375808:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 558us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.859349:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 204 00000100:00100000:0.0:1789024121.861928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.862057:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376064 00000100:00100000:2.0:1789024121.862081:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376064 00000100:00100000:2.0:1789024121.862138:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:2.0:1789024121.862181:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12387:x1875927402376064:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024121.862396:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+28:12387:x1875927402376064:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 249us (476us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789024121.862404:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:1.0:1789024121.912231:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024121.912557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376320 00000100:00100000:3.0:1789024121.912567:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376320 00000100:00100000:3.0:1789024121.912778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 205 00000100:00100000:3.0:1789024121.912791:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+28:11919:x1875927402376320:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024121.912815:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024121.912835:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a200/0xa736ef4b98cb43d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af756 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.912944:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.912958:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 29 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.912967:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.913007:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 29 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024121.913020:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 29 pid: 13818 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024121.913033:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422353280:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024121.913135:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024121.917796:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.917968:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376448 00000100:00100000:2.0:1789024121.917983:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376448 00010000:00010000:2.0:1789024121.918026:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 30 pid: 13818 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024121.918083:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 92 00000100:00100000:2.0:1789024121.918092:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+30:2403:x1875927402376448:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024121.918107:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024121.918114:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 30 pid: 13818 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.918127:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 30 pid: 13818 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.918176:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024121.918182:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.918195:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.918202:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.918222:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024121.918281:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+30:2403:x1875927402376448:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 189us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.918288:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 92 00010000:00010000:0.0:1789024121.918752:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b000/0xa736ef4b98cb43be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af74f expref: 29 pid: 13818 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024121.918770:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422353280:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024121.918791:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.918799:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.918805:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024121.918823:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789024121.918944:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a200/0xa736ef4b98cb43d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.918959:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024121.918966:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:0.0:1789024121.918968:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789024121.918971:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338ae00, rc 0) 00000100:00100000:0.0:1789024121.919027:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+29:11919:x1875927402376320:12345-192.168.202.18@tcp:101:bash.0 Request processed in 6240us (6805us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789024121.924035:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.924232:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376576 00000100:00100000:2.0:1789024121.924259:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376576 00000100:00100000:0.0:1789024121.925281:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 205 00000100:00100000:2.0:1789024121.925489:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 206 00000100:00100000:2.0:1789024121.925505:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+29:11919:x1875927402376576:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024121.925530:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024121.925566:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb43e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af75d expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925602:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb43ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925614:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb43ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925625:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb43ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925763:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb43e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af75d expref: 31 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925780:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb43ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af75d expref: 30 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.925789:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024121.925791:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789024121.925795:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5e00, rc 0) 00000100:00100000:2.0:1789024121.925873:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11919:x1875927402376576:12345-192.168.202.18@tcp:101:bash.0 Request processed in 374us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024121.925880:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 206 00000100:00100000:0.0:1789024121.930749:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.930841:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376832 00000100:00100000:2.0:1789024121.930924:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376832 00000100:00100000:2.0:1789024121.931031:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 207 00000100:00100000:2.0:1789024121.931043:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+30:11919:x1875927402376832:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:2.0:1789024121.931303:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.931320:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.931332:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789024121.931374:0:7824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789024121.931397:0:7824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df69aa35 reply state 0000000012f87fa1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.931409:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024121.931416:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024121.931419:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024121.931423:0:7824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789024121.931508:0:7824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789024121.932042:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+34:11919:x1875927402376832:12345-192.168.202.18@tcp:36:bash.0 Request processed in 999us (1301us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789024121.932052:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 207 00000020:00080000:2.0:1789024121.932113:0:7824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789024121.934494:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.935068:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402376960 00000100:00100000:1.0:1789024121.935078:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402376960 00000100:00100000:1.0:1789024121.935138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 208 00000100:00100000:1.0:1789024121.935166:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+34:11919:x1875927402376960:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024121.935191:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024121.935214:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb43fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af764 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.935278:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb43fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af764 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.935293:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb43fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af764 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.935312:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:1.0:1789024121.935315:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024121.935319:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323c00, rc 0) 00000100:00100000:1.0:1789024121.935380:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+35:11919:x1875927402376960:12345-192.168.202.18@tcp:101:bash.0 Request processed in 232us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024121.935386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 208 00000100:00100000:3.0:1789024121.940046:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024121.940306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377088 00000100:00100000:1.0:1789024121.940317:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377088 00000100:00100000:1.0:1789024121.940375:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:1.0:1789024121.940384:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+7:11919:x1875927402377088:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024121.940402:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024121.940422:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af76b expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024121.940471:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa25778, atime: 0x6aa25777, ctime: 0x6aa25778, blocks: 0x8 00010000:00010000:1.0:1789024121.940494:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1789024121.940498:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024121.940506:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.940524:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024121.940536:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323200, rc 0) 00000100:00100000:1.0:1789024121.940798:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:11919:x1875927402377088:12345-192.168.202.18@tcp:101:bash.0 Request processed in 414us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024121.940806:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:1.0:1789024121.944096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024121.944285:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377216 00000100:00100000:2.0:1789024121.944294:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377216 00002000:00010000:2.0:1789024121.944334:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789024121.944339:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc07484700 with x1875927402377216 ext(0->18446744073709551615) 00002000:00010000:2.0:1789024121.944362:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc07484700. 00000100:00100000:2.0:1789024121.944399:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:2.0:1789024121.944408:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2401:x1875927402377216:12345-192.168.202.18@tcp:10:bash.0 00002000:00010000:2.0:1789024121.944690:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789024121.944694:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789024120 -> 1789024122 00002000:00010000:2.0:1789024121.944696:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789024119 -> 1789024119 00002000:00010000:2.0:1789024121.944699:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789024120 -> 1789024122 00002000:00010000:2.0:1789024121.944701:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789024121.944765:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2401:x1875927402377216:12345-192.168.202.18@tcp:10:bash.0 Request processed in 357us (677us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789024121.944773:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00002000:00010000:2.0:1789024121.944777:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789024121.944780:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc07484700 with x1875927402377216 ext(0->18446744073709551615) 00002000:00010000:2.0:1789024121.944784:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc07484700. 00000100:00100000:3.0:1789024122.086511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.086615:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377344 00000100:00100000:2.0:1789024122.086660:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377344 00000100:00100000:2.0:1789024122.086739:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 209 00000100:00100000:2.0:1789024122.086750:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+35:12401:x1875927402377344:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:2.0:1789024122.086819:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086837:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086850:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086885:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086893:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086900:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086972:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086981:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.086988:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024122.087036:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087048:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087055:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789024122.087192:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789024122.087376:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087384:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024122.087388:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087404:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087416:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024122.087419:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024122.087424:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087430:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb440b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087444:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087460:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087466:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087536:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024122.087539:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087545:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087553:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7000) 00010000:00010000:2.0:1789024122.087556:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024122.087559:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087575:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4412 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087593:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087598:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087604:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087609:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024122.087612:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087617:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087729:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024122.087733:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024122.087737:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.087743:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4419 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024122.087883:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc30c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+35:12401:x1875927402377344:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 1133us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024122.087892:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 209 00000100:00100000:3.0:1789024122.153186:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.153291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377600 00000100:00100000:0.0:1789024122.153302:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377600 00000100:00100000:0.0:1789024122.153371:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 210 00000100:00100000:0.0:1789024122.153381:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+35:12404:x1875927402377600:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024122.153400:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.153421:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb4420 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af772 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153489:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153516:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153530:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153538:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153559:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153676:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153697:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153705:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.153715:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789024122.153784:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153792:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153799:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153805:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.153810:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153816:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153827:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024122.153830:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024122.153835:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153840:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb4427 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153863:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153874:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153880:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153885:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.153888:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153894:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153901:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc11d52d00) 00010000:00010000:0.0:1789024122.153903:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024122.153905:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153910:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb442e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb4420 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af772 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153957:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af772 expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.153963:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:0.0:1789024122.153966:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789024122.153973:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ec00, rc 0) 00000100:00100000:0.0:1789024122.154037:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12404:x1875927402377600:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 657us (889us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789024122.154045:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 210 00000100:00100000:1.0:1789024122.158134:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.158318:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377728 00000100:00100000:0.0:1789024122.158329:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377728 00000100:00100000:0.0:1789024122.158389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:0.0:1789024122.158400:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12404:x1875927402377728:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:0.0:1789024122.158468:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.158484:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.158493:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.158524:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.158538:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 37 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.158566:0:6515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422353408:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024122.158670:0:6515:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789024122.161750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.161869:0:6515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03940a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875927422353408:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024122.161896:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024122.162986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402377984 00000100:00100000:2.0:1789024122.162998:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402377984 00000100:00100000:2.0:1789024122.163113:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:2.0:1789024122.163125:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+38:6171:x1875927402377984:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789024122.163438:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+39:6171:x1875927402377984:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 315us (1704us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789024122.163446:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:2.0:1789024122.166960:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.167084:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402378112 00000100:00100000:3.0:1789024122.167096:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402378112 00010000:00010000:3.0:1789024122.167143:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 39 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.167549:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 93 00000100:00100000:3.0:1789024122.167560:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+39:2402:x1875927402378112:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024122.167576:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024122.167583:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 39 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167602:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 39 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167637:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb43da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af756 expref: 39 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167654:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:3.0:1789024122.167660:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167690:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167697:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.167733:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024122.167797:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+38:2402:x1875927402378112:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 239us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.167804:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 93 00010000:00010000:0.0:1789024122.168750:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168761:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168805:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168813:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168820:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168827:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.168832:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168839:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168852:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:0.0:1789024122.168856:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024122.168860:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.168867:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.168949:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12404:x1875927402377728:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 10549us (10821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.168971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 211 00000100:00100000:2.0:1789024122.179010:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.179201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402378368 00000100:00100000:1.0:1789024122.179213:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402378368 00000100:00100000:1.0:1789024122.179276:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:1.0:1789024122.179287:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+37:12404:x1875927402378368:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:1.0:1789024122.179524:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+38:12404:x1875927402378368:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 239us (525us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789024122.179533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:1.0:1789024122.278250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.278387:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402378624 00000100:00100000:2.0:1789024122.278397:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402378624 00000100:00100000:2.0:1789024122.278460:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 212 00000100:00100000:2.0:1789024122.278470:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+38:12415:x1875927402378624:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:2.0:1789024122.278495:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024122.278517:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb444a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af779 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278591:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278605:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278616:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278646:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278671:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278679:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278792:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb445f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278801:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb445f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.278808:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb445f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024122.278817:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789024122.279103:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279111:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279118:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279124:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024122.279128:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279135:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279195:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:2.0:1789024122.279199:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024122.279204:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279210:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5600/0xa736ef4b98cb4451 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279225:0:13818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279231:0:13818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279236:0:13818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279241:0:13818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024122.279244:0:13818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279250:0:13818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279257:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc41bc7000) 00010000:00010000:2.0:1789024122.279259:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024122.279262:0:13818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279267:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb4458 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279323:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb444a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af779 expref: 41 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279336:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb445f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af779 expref: 40 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.279343:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024122.279345:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789024122.279348:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5400, rc 0) 00000100:00100000:2.0:1789024122.279415:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12415:x1875927402378624:12345-192.168.202.18@tcp:101:cat.0 Request processed in 947us (1175us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789024122.279423:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 212 00000100:00100000:3.0:1789024122.285220:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.285470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402378880 00000100:00100000:1.0:1789024122.285494:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402378880 00000100:00100000:1.0:1789024122.285553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:1.0:1789024122.285563:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+40:12415:x1875927402378880:12345-192.168.202.18@tcp:35:cat.0 00000100:00100000:1.0:1789024122.285875:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+41:12415:x1875927402378880:12345-192.168.202.18@tcp:35:cat.0 Request processed in 312us (663us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789024122.285883:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:3.0:1789024122.307792:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.308079:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402379136 00000100:00100000:2.0:1789024122.308090:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402379136 00000100:00100000:3.0:1789024122.308280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 213 00000100:00100000:3.0:1789024122.308293:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+41:12416:x1875927402379136:12345-192.168.202.18@tcp:36:rm.0 00010000:00010000:3.0:1789024122.308357:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789024122.308385:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323c00/0xa736ef4b98cb43fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af764 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308407:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb445f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af779 expref: 40 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308422:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ec00/0xa736ef4b98cb4435 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af772 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308434:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb43ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af75d expref: 38 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308465:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:3.0:1789024122.308470:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024122.308492:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308504:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308514:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308528:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308535:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308542:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308619:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308641:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.308649:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024122.309065:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1789024122.309079:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440344931562ns, next at 441344928024ns, rc = 0 00010000:00010000:3.0:1789024122.309130:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309139:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309395:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309406:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309412:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309419:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309440:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024122.309459:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309466:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309472:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309477:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.309482:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309489:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309504:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:3.0:1789024122.309507:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789024122.309512:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309518:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb447b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309534:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309540:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309545:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309550:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.309553:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309558:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309564:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024122.309566:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.309569:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309574:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb446d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024122.309594:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0e3804c reply state 000000003feb4241 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309605:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.309612:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024122.309614:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024122.309616:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024122.309711:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+39:12416:x1875927402379136:12345-192.168.202.18@tcp:36:rm.0 Request processed in 1418us (1925us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789024122.309719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 213 00010000:00010000:2.0:1789024122.309840:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024122.309847:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.309868:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024122.309871:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.309878:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.309887:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:2.0:1789024122.309889:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789024122.309892:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.309905:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb4482 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.309915:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024122.309917:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024122.309919:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024122.355884:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.355988:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402379392 00000100:00100000:3.0:1789024122.355998:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402379392 00000100:00100000:3.0:1789024122.356066:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 214 00000100:00100000:3.0:1789024122.356076:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+39:12422:x1875927402379392:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024122.356101:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024122.356121:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4489 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af780 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356283:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356297:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356307:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356328:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356336:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356343:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024122.356672:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1789024122.356809:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356818:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356825:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356857:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356865:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356872:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356878:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.356884:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356902:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356915:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024122.356919:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.356924:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356931:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb4490 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024122.356945:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000564e5d5c reply state 000000003a6a3ec7 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356956:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.356962:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024122.356965:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024122.356968:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789024122.356995:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4489 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.357010:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.357019:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024122.357021:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024122.357023:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a400, rc 0) 00000100:00100000:3.0:1789024122.357102:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+42:12422:x1875927402379392:12345-192.168.202.18@tcp:101:bash.0 Request processed in 1028us (1229us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789024122.357117:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 214 00000100:00100000:1.0:1789024122.364541:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.364652:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402379520 00000100:00100000:0.0:1789024122.364664:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402379520 00000100:00100000:0.0:1789024122.364792:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:0.0:1789024122.364802:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402379520:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:0.0:1789024122.364822:0:8904:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.364845:0:8904:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af787 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024122.364882:0:8904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024122.364908:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1789024122.364913:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024122.364923:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 8 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.364940:0:8904:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 8 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.364952:0:8904:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f000, rc 0) 00000100:00100000:0.0:1789024122.365382:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402379520:12345-192.168.202.18@tcp:101:bash.0 Request processed in 579us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.365389:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00080000:3.0:1789024122.366520:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024122.369258:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.369410:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402379648 00000100:00100000:2.0:1789024122.369421:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402379648 00000100:00100000:2.0:1789024122.369481:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:2.0:1789024122.369491:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:12422:x1875927402379648:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024122.369509:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024122.369528:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af78e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.369558:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 9 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.369567:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024122.369571:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024122.369577:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.369609:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 9 pid: 8904 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.369640:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 9 pid: 8904 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024122.369669:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875927422353536:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024122.369768:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024122.373007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.373140:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402379776 00000100:00100000:0.0:1789024122.373185:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402379776 00010000:00010000:0.0:1789024122.373223:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 10 pid: 8904 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.373270:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00100000:0.0:1789024122.373280:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402379776:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024122.373299:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024122.373321:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 10 pid: 8904 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.373334:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 10 pid: 8904 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.373359:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024122.373363:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024122.373372:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.373381:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.373417:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 10 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.373431:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875927422353664:192.168.202.18@tcp:105: 00000100:00100000:0.0:1789024122.373509:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd240 going to sleep for 11 seconds 00010000:00010000:3.0:1789024122.374317:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e70eecc/0xa736ef4b98cb44ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af787 expref: 10 pid: 8904 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.374334:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875927422353536:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024122.374358:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.374370:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:3.0:1789024122.374419:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:12422:x1875927402379648:12345-192.168.202.18@tcp:101:bash.0 Request processed in 4929us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.374428:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:2.0:1789024122.377791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.377910:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1875927422353664:192.168.202.18@tcp:105: 00010000:00010000:0.0:1789024122.377932:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024122.377993:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402379776:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 4714us (4993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.378003:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 94 00000100:00100000:1.0:1789024122.378240:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380032 00000100:00100000:1.0:1789024122.378248:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380032 00000100:00100000:1.0:1789024122.378297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:1.0:1789024122.378306:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+42:12422:x1875927402380032:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:1.0:1789024122.378548:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12422:x1875927402380032:12345-192.168.202.18@tcp:35:bash.0 Request processed in 243us (765us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789024122.378555:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:1.0:1789024122.581261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.581361:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380160 00000100:00100000:0.0:1789024122.581372:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380160 00000100:00100000:0.0:1789024122.581440:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 215 00000100:00100000:0.0:1789024122.581451:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+43:12438:x1875927402380160:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024122.581479:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.581503:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb44ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af795 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581567:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581582:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581593:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.581645:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789024122.581649:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024122.581670:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581693:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f000/0xa736ef4b98cb44ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af795 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581729:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af795 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.581738:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024122.581741:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024122.581745:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252fa00, rc 0) 00000100:00100000:0.0:1789024122.581810:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2d0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+44:12438:x1875927402380160:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 362us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.581815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 215 00000100:00100000:2.0:1789024122.588761:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.588838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380416 00000100:00100000:3.0:1789024122.588847:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380416 00000100:00100000:3.0:1789024122.588909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 216 00000100:00100000:3.0:1789024122.588918:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+44:12438:x1875927402380416:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024122.588938:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024122.588956:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb44c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af79c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.589073:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb44cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.589085:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb44cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.589114:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb44cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024122.589127:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789024122.589439:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb44c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af79c expref: 47 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.589457:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb44cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af79c expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.589465:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024122.589468:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024122.589472:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a800, rc 0) 00000100:00100000:3.0:1789024122.589532:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+46:12438:x1875927402380416:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 614us (781us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789024122.589539:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 216 00000100:00100000:3.0:1789024122.593164:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.593213:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.593391:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380800 00000100:00100000:1.0:1789024122.593402:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380800 00000100:00100000:1.0:1789024122.593473:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789024122.593483:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+46:2400:x1875927402380800:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024122.593499:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024122.593521:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb44cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af79c expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.593541:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:1.0:1789024122.593546:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024122.593608:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+45:2400:x1875927402380800:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 126us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024122.593642:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:2.0:1789024122.593999:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380672 00000100:00100000:2.0:1789024122.594005:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380672 00000100:00100000:2.0:1789024122.594039:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 217 00000100:00100000:2.0:1789024122.594046:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+45:12438:x1875927402380672:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024122.594072:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024122.594088:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb44dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7a3 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.594223:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.594239:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.594251:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024122.594263:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789024122.594356:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb44dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7a3 expref: 48 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.594373:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7a3 expref: 47 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.594388:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:2.0:1789024122.594391:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789024122.594393:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5e00, rc 0) 00000100:00100000:2.0:1789024122.594422:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+47:12438:x1875927402380672:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 376us (1287us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789024122.594428:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 217 00000100:00100000:3.0:1789024122.601066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.601187:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402380928 00000100:00100000:1.0:1789024122.601198:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402380928 00000100:00100000:1.0:1789024122.601257:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:1.0:1789024122.601268:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402380928:12345-192.168.202.18@tcp:1:lfs.0 00010000:00010000:1.0:1789024122.601313:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.601332:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.601341:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024122.601345:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024122.601349:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.601384:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.601398:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 8 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024122.601413:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875927422353792:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024122.601491:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc421cd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024122.604994:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.605082:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381056 00000100:00100000:2.0:1789024122.605092:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381056 00002000:00100000:2.0:1789024122.605141:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90cc3fa7fb80 x1875927402381056/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:293/0 lens 504/0 e 0 to 0 dl 1789024133 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789024122.605177:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3fa7fb80 with x1875927402381056 ext(0->8) 00010000:00010000:2.0:1789024122.605186:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 9 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.605202:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 9 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024122.605209:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cc3fa7fb80 00000100:00100000:2.0:1789024122.605243:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024122.605252:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2403:x1875927402381056:12345-192.168.202.18@tcp:4:lfs.0 00000100:00100000:3.0:1789024122.606014:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875927422353792:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024122.606041:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.606710:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2403:x1875927402381056:12345-192.168.202.18@tcp:4:lfs.0 Request processed in 1457us (1733us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789024122.606720:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00002000:00100000:3.0:1789024122.606741:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90cc3fa7fb80 x1875927402381056/t4294967309(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:293/0 lens 504/448 e 0 to 0 dl 1789024133 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789024122.606750:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3fa7fb80 with x1875927402381056 ext(0->8) 00010000:00010000:3.0:1789024122.606758:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.606771:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024122.606778:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff90cc3fa7fb80 00000100:00100000:0.0:1789024122.609691:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.609789:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381184 00000100:00100000:1.0:1789024122.609798:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381184 00010000:00010000:1.0:1789024122.609840:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024122.609893:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 95 00000100:00100000:1.0:1789024122.609904:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2401:x1875927402381184:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024122.609920:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789024122.609937:0:7924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789024122.609940:0:7924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789024122 00002000:00010000:1.0:1789024122.609942:0:7924:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789024123 00002000:00010000:1.0:1789024122.609944:0:7924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789024122 00002000:00010000:1.0:1789024122.609946:0:7924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789024122.609952:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.609964:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.609995:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403aceec/0xa736ef4b98cb44b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af78e expref: 11 pid: 8431 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.610011:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024122.610015:0:7924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024122.610021:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.610049:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.610090:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024122.610183:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2401:x1875927402381184:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 245us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024122.610191:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 95 00010000:00010000:3.0:1789024122.610619:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610638:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610658:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610666:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610673:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610679:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024122.610690:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610700:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610711:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.610719:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb44f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.610784:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2403:x1875927402380928:12345-192.168.202.18@tcp:1:lfs.0 Request processed in 9519us (9737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.610792:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:0.0:1789024122.613898:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.613961:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381440 00000100:00100000:1.0:1789024122.613970:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381440 00000100:00100000:1.0:1789024122.614028:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:1.0:1789024122.614037:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+47:12438:x1875927402381440:12345-192.168.202.18@tcp:35:lfs.0 00000004:00010000:1.0:1789024122.614107:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7a3 expref: 47 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024122.614320:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789024122.614352:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789024122.614614:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789024122.614664:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.614678:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.614687:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.614720:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 51 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.614749:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 51 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024122.614764:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875927422353920:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024122.614849:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024122.617262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.617352:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381568 00000100:00100000:3.0:1789024122.617361:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381568 00010000:00010000:3.0:1789024122.617401:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 52 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.617440:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 96 00000100:00100000:3.0:1789024122.617449:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+52:2402:x1875927402381568:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024122.617463:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024122.617470:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 52 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.617483:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 52 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.617516:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:3.0:1789024122.617522:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.617532:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.617539:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.617559:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024122.617608:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+52:2402:x1875927402381568:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.617616:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 96 00010000:00010000:1.0:1789024122.618171:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb449e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af780 expref: 51 pid: 6515 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024122.618190:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875927422353920:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024122.618211:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.618220:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.618226:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024122.618318:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789024122.618418:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789024122.618495:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422354048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789024122.618548:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024122.618575:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4180 going to sleep for 11 seconds 00000100:00100000:3.0:1789024122.618762:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422354048 00000100:00100000:3.0:1789024122.618768:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422354048 00000100:00100000:3.0:1789024122.618811:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789024122.618819:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1875927422354048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789024122.618925:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1875927422354048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.618932:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789024122.619360:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422354048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789024122.619475:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789024122.619529:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422354176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789024122.619638:0:6518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024122.619665:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb039d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789024122.619816:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422354176 00000100:00100000:3.0:1789024122.619821:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422354176 00000100:00100000:3.0:1789024122.619865:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789024122.619873:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1875927422354176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789024122.620105:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6518:x1875927422354176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (465us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789024122.620121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789024122.620369:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f39f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875927422354176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789024122.620417:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789024122.620453:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620462:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620470:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620476:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.620481:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620489:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620511:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:0.0:1789024122.620514:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789024122.620519:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.620525:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb44f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789024122.620633:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789024122.620690:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789024122.620702:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440656554872ns, next at 441656552513ns, rc = 0 00000001:00080000:0.0:1789024122.620709:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789024122.620730:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cb0231b200) 00010000:00010000:0.0:1789024122.620732:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789024122.620739:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5e00/0xa736ef4b98cb44e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7a3 expref: 55 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.620835:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+54:12438:x1875927402381440:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 6799us (6943us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789024122.620844:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 56 00000020:00080000:0.0:1789024122.620847:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789024122.624818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.624903:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381696 00000100:00100000:1.0:1789024122.624913:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381696 00000100:00100000:1.0:1789024122.624982:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 218 00000100:00100000:1.0:1789024122.624994:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+54:12438:x1875927402381696:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024122.625037:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024122.625062:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb4500 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7aa expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.625119:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb4500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7aa expref: 55 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.625133:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb4500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7aa expref: 55 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.625189:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024122.625192:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024122.625196:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323e00, rc 0) 00000100:00100000:1.0:1789024122.625250:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+55:12438:x1875927402381696:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 258us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024122.625265:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 218 00000100:00100000:2.0:1789024122.628965:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.629117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402381952 00000100:00100000:0.0:1789024122.629132:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402381952 00000100:00100000:0.0:1789024122.629236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:0.0:1789024122.629248:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+55:12438:x1875927402381952:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:0.0:1789024122.629520:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+56:12438:x1875927402381952:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 274us (565us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789024122.629546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:2.0:1789024122.698778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.699077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402382080 00000100:00100000:3.0:1789024122.699087:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402382080 00000100:00100000:3.0:1789024122.699173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 219 00000100:00100000:3.0:1789024122.699185:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+56:12448:x1875927402382080:12345-192.168.202.18@tcp:34:lfs.0 00010000:00010000:3.0:1789024122.699258:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699276:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699289:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699301:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699309:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699317:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699386:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699395:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699403:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024122.699468:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699479:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699485:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699492:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699497:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.699501:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699508:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699520:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024122.699523:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.699528:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699534:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4507 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699546:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699552:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699565:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699569:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.699572:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699578:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699585:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024122.699588:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.699591:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699596:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb450e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699605:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699611:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699616:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699637:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338bc00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.699640:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699658:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699667:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.699669:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.699673:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.699678:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4515 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.699762:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+56:12448:x1875927402382080:12345-192.168.202.18@tcp:34:lfs.0 Request processed in 579us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.699770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 219 00000100:00100000:3.0:1789024122.747781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.747901:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402382336 00000100:00100000:0.0:1789024122.747912:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402382336 00000100:00100000:0.0:1789024122.747975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 220 00000100:00100000:0.0:1789024122.747994:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+56:12451:x1875927402382336:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024122.748014:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.748035:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb451c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748208:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748220:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748231:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748237:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748244:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748338:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748356:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748363:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.748373:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789024122.748455:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748463:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748470:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748476:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.748480:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748488:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748499:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024122.748502:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024122.748506:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748512:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4523 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748523:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748535:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748541:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748546:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.748549:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748554:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748562:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:0.0:1789024122.748564:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024122.748567:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748573:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb452a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748608:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb451c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748634:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.748641:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.748643:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024122.748652:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024122.748718:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12451:x1875927402382336:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 726us (946us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789024122.748726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 220 00000100:00100000:1.0:1789024122.752263:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.752350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402382464 00000100:00100000:0.0:1789024122.752361:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402382464 00000100:00100000:0.0:1789024122.752422:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 221 00000100:00100000:0.0:1789024122.752432:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12451:x1875927402382464:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:0.0:1789024122.752508:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752526:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752538:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752574:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752581:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752587:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752593:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024122.752597:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752604:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752649:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.752651:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789024122.752656:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.752661:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e800/0xa736ef4b98cb453f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.752729:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12451:x1875927402382464:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 297us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.752736:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 221 00000100:00100000:2.0:1789024122.756506:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.756583:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402382720 00000100:00100000:0.0:1789024122.756595:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402382720 00000100:00100000:0.0:1789024122.756657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:0.0:1789024122.756667:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+58:12451:x1875927402382720:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:0.0:1789024122.756895:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12451:x1875927402382720:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 228us (396us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789024122.756902:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 58 00010000:00010000:3.0:1789024122.764314:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024122.850312:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.850393:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402382976 00000100:00100000:3.0:1789024122.850403:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402382976 00000100:00100000:3.0:1789024122.850453:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 222 00000100:00100000:3.0:1789024122.850463:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12461:x1875927402382976:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024122.850488:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024122.850491:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789024122.850522:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fa00/0xa736ef4b98cb44c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af795 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850542:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024122.850547:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024122.850561:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4546 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7b8 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850684:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850697:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850705:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850735:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.850748:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 59 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.850760:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354304:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024122.851042:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417300 going to sleep for 11 seconds 00000100:00100000:1.0:1789024122.855730:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.855836:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354304:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024122.855863:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024122.856105:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402383104 00000100:00100000:2.0:1789024122.856113:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402383104 00010000:00010000:2.0:1789024122.856181:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 60 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024122.856269:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 97 00000100:00100000:2.0:1789024122.856279:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+60:2403:x1875927402383104:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024122.856292:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024122.856298:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 60 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856310:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 60 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856331:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb4531 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b1 expref: 60 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856347:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:2.0:1789024122.856352:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856378:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856386:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024122.856407:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024122.856451:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+59:2403:x1875927402383104:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 174us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024122.856459:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 97 00010000:00010000:3.0:1789024122.856518:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.856524:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024122.856538:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789024122.856657:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4546 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 60 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.856668:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 59 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.856673:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.856675:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024122.856677:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338aa00, rc 0) 00000100:00100000:3.0:1789024122.856696:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12461:x1875927402382976:12345-192.168.202.18@tcp:101:bash.0 Request processed in 6237us (6396us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789024122.856700:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 222 00000100:00100000:3.0:1789024122.859517:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024122.859593:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402383232 00000100:00100000:1.0:1789024122.859601:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402383232 00000100:00100000:1.0:1789024122.859698:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 223 00000100:00100000:1.0:1789024122.859708:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+59:12461:x1875927402383232:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:1.0:1789024122.859731:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024122.859750:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb455b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7bf expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859783:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859807:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859817:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859923:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb455b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 61 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859941:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 60 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024122.859949:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024122.859951:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024122.859955:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322400, rc 0) 00000100:00100000:1.0:1789024122.860022:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+60:12461:x1875927402383232:12345-192.168.202.18@tcp:101:bash.0 Request processed in 315us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024122.860029:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 223 00000100:00100000:2.0:1789024122.864431:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.864559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402383488 00000100:00100000:3.0:1789024122.864570:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402383488 00000100:00100000:3.0:1789024122.864638:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 224 00000100:00100000:3.0:1789024122.864649:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2c274050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+60:12461:x1875927402383488:12345-192.168.202.18@tcp:36:bash.0 00010000:00010000:3.0:1789024122.864860:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.864876:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.864888:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789024122.864927:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1789024122.864947:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009a05651 reply state 000000007e3d324e transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.865093:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.865105:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.865108:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024122.865111:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024122.865435:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2c274050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12461:x1875927402383488:12345-192.168.202.18@tcp:36:bash.0 Request processed in 786us (1012us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789024122.865443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 224 00000020:00080000:3.0:1789024122.865448:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789024122.871850:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.871946:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402383616 00000100:00100000:3.0:1789024122.871957:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402383616 00000100:00100000:3.0:1789024122.872038:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 225 00000100:00100000:3.0:1789024122.872049:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12461:x1875927402383616:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024122.872072:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024122.872092:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb4570 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7c6 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.872502:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.872518:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 64 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.872527:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.872561:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 64 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.872588:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 64 pid: 13818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.872603:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354432:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024122.872698:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417300 going to sleep for 11 seconds 00000100:00100000:0.0:1789024122.875389:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354432:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024122.875424:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.877333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.877639:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402383744 00000100:00100000:3.0:1789024122.877648:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402383744 00010000:00010000:3.0:1789024122.877686:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 65 pid: 13818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.877727:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 98 00000100:00100000:3.0:1789024122.877737:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+65:2402:x1875927402383744:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024122.877751:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024122.877758:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 65 pid: 13818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.877770:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 65 pid: 13818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.877791:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb454d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7b8 expref: 65 pid: 13818 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.877806:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.877811:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.877836:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.877843:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.878080:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024122.878137:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+64:2402:x1875927402383744:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 401us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.878184:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 98 00010000:00010000:0.0:1789024122.879396:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.879424:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.879478:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789024122.879483:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024122.879506:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.879540:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb4570 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 64 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.879559:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 63 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.879567:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.879570:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024122.879573:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338b800, rc 0) 00000100:00100000:0.0:1789024122.879725:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12461:x1875927402383616:12345-192.168.202.18@tcp:101:bash.0 Request processed in 7677us (7884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.879733:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 225 00000100:00100000:0.0:1789024122.883661:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.883747:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384000 00000100:00100000:2.0:1789024122.883757:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384000 00000100:00100000:2.0:1789024122.883808:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:2.0:1789024122.883817:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+63:12461:x1875927402384000:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:2.0:1789024122.884042:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12461:x1875927402384000:12345-192.168.202.18@tcp:35:bash.0 Request processed in 225us (389us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789024122.884049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:3.0:1789024122.968725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.970968:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384128 00000100:00100000:0.0:1789024122.970994:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384128 00000100:00100000:0.0:1789024122.971063:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 226 00000100:00100000:0.0:1789024122.971074:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+64:12467:x1875927402384128:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024122.971100:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.971122:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb457e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971243:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971259:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971272:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.971313:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789024122.971316:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024122.971334:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971358:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb457e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7cd expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971375:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7cd expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.971383:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024122.971386:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024122.971390:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e000, rc 0) 00000100:00100000:0.0:1789024122.971515:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402384128:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 443us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.971522:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 226 00000100:00100000:1.0:1789024122.977090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.977357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384256 00000100:00100000:3.0:1789024122.977367:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384256 00000100:00100000:3.0:1789024122.977453:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 227 00000100:00100000:3.0:1789024122.977464:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402384256:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024122.977483:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024122.977505:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb458c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977566:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977580:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977593:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977603:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977700:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977708:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977781:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977791:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.977798:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024122.977838:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789024122.977842:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024122.978038:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978058:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978065:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978071:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978087:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338bc00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.978091:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978098:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978110:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024122.978113:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.978118:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978124:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb4593 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978137:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978143:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978471:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978476:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024122.978479:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978485:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978504:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:3.0:1789024122.978507:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024122.978510:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978516:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb459a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978546:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb458c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978559:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.978565:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.978567:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024122.978570:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a000, rc 0) 00000100:00100000:3.0:1789024122.978862:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12467:x1875927402384256:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1388us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.978872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 227 00000100:00100000:2.0:1789024122.985090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024122.985329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.985818:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384512 00000100:00100000:0.0:1789024122.985828:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384512 00000100:00100000:0.0:1789024122.985952:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 228 00000100:00100000:0.0:1789024122.985963:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12467:x1875927402384512:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024122.985992:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024122.986013:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7db expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986120:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986135:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 67 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986158:0:13818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986168:0:13818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986199:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986212:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 67 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.986223:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354560:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024122.986373:0:13818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 67 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.986394:0:13818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 67 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.986403:0:13818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354688:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024122.986428:0:13818:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789024122.986661:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384640 00000100:00100000:3.0:1789024122.986667:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384640 00010000:00010000:3.0:1789024122.986689:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 68 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.986710:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:3.0:1789024122.986718:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+68:2403:x1875927402384640:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024122.986736:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024122.986742:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 68 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.986753:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 68 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.986769:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.986773:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.986779:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.986785:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024122.986810:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+68:2403:x1875927402384640:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 93us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.986817:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 99 00000100:00100000:2.0:1789024122.990786:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.990889:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402384768 00000100:00100000:3.0:1789024122.990897:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402384768 00010000:00010000:3.0:1789024122.990935:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 68 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024122.990985:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 100 00000100:00100000:3.0:1789024122.990994:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:2402:x1875927402384768:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024122.991009:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024122.991016:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 68 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.991047:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 68 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.991069:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024122.991075:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.991085:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.991093:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.991113:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024122.991195:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:2402:x1875927402384768:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 201us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.991202:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 100 00010000:00010000:0.0:1789024122.992733:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b800/0xa736ef4b98cb4577 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7c6 expref: 67 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.992758:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354688:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024122.992775:0:13818:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.18@tcp) returned -22 from blocking AST (req@000000002af41505 x1875927422354560) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 66 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.992790:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a000/0xa736ef4b98cb45a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7d4 expref: 66 pid: 6516 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024122.992799:0:13818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13818:1875927422354560:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024122.992819:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.992827:0:13818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.992836:0:13818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.992842:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024122.992937:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789024122.993123:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 67 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.993137:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 66 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.993311:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.993316:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789024122.993319:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f600, rc 0) 00000100:00100000:0.0:1789024122.993384:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12467:x1875927402384512:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 7422us (8302us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789024122.993392:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 228 00000100:00100000:3.0:1789024122.996242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024122.996347:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385024 00000100:00100000:0.0:1789024122.996357:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385024 00000100:00100000:0.0:1789024122.996413:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:0.0:1789024122.996423:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12467:x1875927402385024:12345-192.168.202.18@tcp:103:lfs.0 00010000:00010000:0.0:1789024122.996440:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024122.996463:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb4500 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7aa expref: 66 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024122.996480:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024122.996485:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024122.996542:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402385024:12345-192.168.202.18@tcp:103:lfs.0 Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024122.996549:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:1.0:1789024122.998738:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024122.998877:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385152 00000100:00100000:3.0:1789024122.998886:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385152 00000100:00100000:3.0:1789024122.998942:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 229 00000100:00100000:3.0:1789024122.998952:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402385152:12345-192.168.202.18@tcp:58:lfs.0 00010000:00010000:3.0:1789024122.999075:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.999092:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024122.999121:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024122.999256:0:7824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789024122.999325:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402385152:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 375us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024122.999332:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 229 00000100:00100000:3.0:1789024123.001420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.001684:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385280 00000100:00100000:1.0:1789024123.001694:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385280 00000100:00100000:1.0:1789024123.001775:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 230 00000100:00100000:1.0:1789024123.001785:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+65:12467:x1875927402385280:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024123.001801:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024123.001818:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001890:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001900:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001917:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001929:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001941:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.001943:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024123.001947:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.001954:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323000, rc 0) 00000100:00100000:1.0:1789024123.002050:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12467:x1875927402385280:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 267us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.002057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 230 00000100:00100000:2.0:1789024123.276523:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024123.276548:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422354816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024123.276652:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024123.276927:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422354816 00000100:00100000:0.0:1789024123.276936:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422354816 00000100:00100000:0.0:1789024123.276995:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789024123.277005:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422354816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024123.277036:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789024123.277089:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422354816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.277096:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789024123.277308:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422354816:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789024123.340897:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024123.340906:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024123.340939:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789024123.340953:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789024123.341299:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422354944:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789024123.341472:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024123.348611:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.348716:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385408 00000100:00100000:0.0:1789024123.348726:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385408 00000100:00100000:0.0:1789024123.348783:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 231 00000100:00100000:0.0:1789024123.348793:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402385408:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789024123.348821:0:13818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789024123.348924:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402385408:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.348931:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 231 00000100:00100000:3.0:1789024123.353257:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422354944:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024123.354093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.354462:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385536 00000100:00100000:0.0:1789024123.354472:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385536 00000100:00100000:0.0:1789024123.354529:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 232 00000100:00100000:0.0:1789024123.354539:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12468:x1875927402385536:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789024123.354609:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354639:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354651:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354681:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354688:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354695:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354716:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354724:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354730:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024123.354770:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789024123.354775:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024123.354788:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354798:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354805:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354811:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354826:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024123.354830:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354837:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354849:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:0.0:1789024123.354862:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024123.354868:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354874:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb45cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354888:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354894:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354900:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354905:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ea00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024123.354908:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354913:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354929:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff90cc11d52800) 00010000:00010000:0.0:1789024123.354931:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024123.354934:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354940:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354953:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354960:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354966:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354971:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024123.354973:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354979:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354986:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024123.354988:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024123.354991:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.354997:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.355092:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12468:x1875927402385536:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 Request processed in 553us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.355099:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 232 00000100:00100000:2.0:1789024123.360811:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.360942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385792 00000100:00100000:1.0:1789024123.360952:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385792 00000100:00100000:1.0:1789024123.361017:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 233 00000100:00100000:1.0:1789024123.361027:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+66:12468:x1875927402385792:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024123.361070:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024123.361089:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb45e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7e9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361219:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361234:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361246:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024123.361257:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789024123.361333:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361340:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361346:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361352:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.361356:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361363:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361374:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.361382:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789024123.361389:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361395:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb45e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361434:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb45e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e9 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361937:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:1.0:1789024123.361939:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789024123.361945:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb45e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e9 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.361956:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322200, rc 0) 00000100:00100000:1.0:1789024123.362268:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402385792:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1241us (1465us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789024123.362277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 233 00000100:00100000:2.0:1789024123.367849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.368306:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402385920 00000100:00100000:1.0:1789024123.368317:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402385920 00000100:00100000:1.0:1789024123.368424:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 234 00000100:00100000:1.0:1789024123.368444:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402385920:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789024123.368487:0:7824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789024123.368704:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402385920:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 271us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.368711:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 234 00000100:00100000:2.0:1789024123.373352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.374428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402386176 00000100:00100000:0.0:1789024123.374552:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402386176 00000100:00100000:0.0:1789024123.374684:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 235 00000100:00100000:0.0:1789024123.374695:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402386176:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789024123.374716:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024123.374719:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789024123.374745:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb4585 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7cd expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.374765:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024123.374770:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024123.374782:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789024123.379364:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789024123.379723:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.379739:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.379751:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.379818:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb45f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f0 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.379852:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f0 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.379860:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cc11d52800) 00010000:00010000:0.0:1789024123.379863:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024123.379867:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ea00, rc 0) 00000100:00100000:0.0:1789024123.380008:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12468:x1875927402386176:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 5314us (6664us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789024123.380017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 235 00000100:00100000:2.0:1789024123.391883:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.392249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402386432 00000100:00100000:1.0:1789024123.392274:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402386432 00000100:00100000:1.0:1789024123.392344:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 236 00000100:00100000:1.0:1789024123.392355:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12468:x1875927402386432:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024123.392414:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024123.392451:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb45fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f0 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392471:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cc11d52800) 00010000:00010000:1.0:1789024123.392482:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024123.392503:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392517:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392528:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392542:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392550:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392556:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392605:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392624:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392638:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392644:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.392648:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392656:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392664:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:1.0:1789024123.392667:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.392671:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392677:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb460a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392686:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392693:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392699:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392703:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.392707:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392722:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392729:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc9e83d0d (ffff90cc33aa9200) 00010000:00010000:1.0:1789024123.392731:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.392734:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.392740:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4611 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc9e83d0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.392830:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402386432:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 478us (957us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789024123.392837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 236 00000100:00100000:2.0:1789024123.396594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.396722:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402386560 00000100:00100000:3.0:1789024123.396731:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402386560 00000100:00100000:3.0:1789024123.396782:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 237 00000100:00100000:3.0:1789024123.396792:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+67:12468:x1875927402386560:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024123.396810:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024123.396831:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4618 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7f7 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.396864:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.396877:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.396904:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.397069:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4618 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 69 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.397090:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 68 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.397098:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:3.0:1789024123.397101:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024123.397104:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338bc00, rc 0) 00000100:00100000:3.0:1789024123.397191:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12468:x1875927402386560:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 400us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.397198:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 237 00000100:00100000:2.0:1789024123.403662:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.403761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402386816 00000100:00100000:0.0:1789024123.403772:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402386816 00000100:00100000:0.0:1789024123.403834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 238 00000100:00100000:0.0:1789024123.403845:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+68:12468:x1875927402386816:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789024123.403925:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.403943:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.403954:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024123.404120:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789024123.404130:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441439983155ns, next at 442439980780ns, rc = 0 00000004:00010000:0.0:1789024123.404228:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003dc3e12 reply state 00000000d02e3b06 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.404259:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.404266:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:0.0:1789024123.404269:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789024123.404273:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789024123.404363:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12468:x1875927402386816:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 519us (711us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789024123.404369:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 238 00000100:00100000:2.0:1789024123.408795:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.408890:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402386944 00000100:00100000:0.0:1789024123.408899:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402386944 00000100:00100000:0.0:1789024123.408957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 239 00000100:00100000:0.0:1789024123.408975:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+70:12468:x1875927402386944:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789024123.408999:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024123.409018:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af7fe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.409073:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.409087:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.409105:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:0.0:1789024123.409108:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789024123.409112:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e000, rc 0) 00000100:00100000:0.0:1789024123.409826:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12468:x1875927402386944:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 857us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.409846:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 239 00000100:00100000:2.0:1789024123.413483:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.413639:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402387072 00000100:00100000:0.0:1789024123.413650:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402387072 00000100:00080000:3.0:1789024123.413771:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024123.413865:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:0.0:1789024123.413876:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402387072:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789024123.414096:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402387072:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 222us (621us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789024123.414103:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 70 00000100:00100000:2.0:1789024123.419298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.419382:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402387328 00000100:00100000:3.0:1789024123.419391:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402387328 00000100:00100000:3.0:1789024123.419457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:3.0:1789024123.419468:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+71:12468:x1875927402387328:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789024123.419702:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+72:12468:x1875927402387328:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 236us (413us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789024123.419710:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:2.0:1789024123.426182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.426552:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402387584 00000100:00100000:3.0:1789024123.426562:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402387584 00000100:00100000:3.0:1789024123.426635:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 240 00000100:00100000:3.0:1789024123.426660:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+72:12468:x1875927402387584:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789024123.426773:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+72:12468:x1875927402387584:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 115us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.426782:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 240 00000100:00100000:2.0:1789024123.429806:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.429903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402387712 00000100:00100000:1.0:1789024123.429914:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402387712 00000100:00100000:1.0:1789024123.429984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 241 00000100:00100000:1.0:1789024123.429994:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+72:12468:x1875927402387712:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024123.430015:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024123.430036:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4634 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af805 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430104:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430120:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430131:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024123.430215:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789024123.430236:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430262:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4634 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af805 expref: 74 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430280:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af805 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.430288:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:1.0:1789024123.430291:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789024123.430294:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322200, rc 0) 00000100:00100000:1.0:1789024123.430353:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+73:12468:x1875927402387712:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 359us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.430361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 241 00000100:00100000:2.0:1789024123.434648:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.435734:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402387840 00000100:00100000:3.0:1789024123.435745:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402387840 00000100:00100000:3.0:1789024123.435814:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:3.0:1789024123.435824:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+10:2402:x1875927402387840:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024123.435839:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024123.435861:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af80c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024123.435885:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2577b, blocks: 0x0 00010000:00010000:3.0:1789024123.435903:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1789024123.435908:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024123.435916:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.435933:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.435946:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338be00, rc 0) 00000100:00100000:3.0:1789024123.436018:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2402:x1875927402387840:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 195us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.436025:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 71 00000100:00100000:2.0:1789024123.455269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.455361:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388096 00000100:00100000:0.0:1789024123.455371:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388096 00000100:00100000:0.0:1789024123.455424:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 242 00000100:00100000:0.0:1789024123.455433:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+73:12468:x1875927402388096:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789024123.455540:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+73:12468:x1875927402388096:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.455547:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 242 00000100:00100000:2.0:1789024123.459905:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.460012:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388224 00000100:00100000:3.0:1789024123.460021:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388224 00000100:00100000:3.0:1789024123.460077:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:3.0:1789024123.460087:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:12468:x1875927402388224:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024123.460105:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024123.460128:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af813 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.460205:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.460216:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024123.460220:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024123.460225:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.460258:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.460271:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.460285:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875927422355072:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024123.460371:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024123.463427:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875927422355072:192.168.202.18@tcp:104: 00010000:00010000:3.0:1789024123.463465:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.463506:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a400, rc 0) 00000100:00100000:3.0:1789024123.463565:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+12:12468:x1875927402388224:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 3479us (3668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.463574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 72 00000100:00100000:0.0:1789024123.469571:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.470107:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388352 00000100:00100000:3.0:1789024123.470118:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388352 00010000:00010000:3.0:1789024123.470208:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.470255:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:3.0:1789024123.470266:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2403:x1875927402388352:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024123.470283:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024123.470306:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.470320:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.470344:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4642 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af80c expref: 12 pid: 8431 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.470363:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024123.470368:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024123.470378:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.470403:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.470444:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.470461:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875927422355200:192.168.202.18@tcp:105: 00000100:00100000:3.0:1789024123.470552:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024123.479979:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875927422355200:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024123.480006:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024123.480071:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2403:x1875927402388352:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 9807us (10511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.480083:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 101 00000100:00100000:2.0:1789024123.480386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.482438:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388480 00000100:00100000:1.0:1789024123.482455:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388480 00002000:00100000:1.0:1789024123.482512:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff90cc08783b80 x1875927402388480/t0(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:294/0 lens 504/0 e 0 to 0 dl 1789024134 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789024123.482524:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc08783b80 with x1875927402388480 ext(0->12) 00002000:00010000:1.0:1789024123.482529:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc08783b80 00000100:00100000:1.0:1789024123.482574:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:1.0:1789024123.482584:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+11:2403:x1875927402388480:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789024123.483721:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+13:2403:x1875927402388480:12345-192.168.202.18@tcp:4:lhsmtool_posix.0 Request processed in 1115us (3313us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789024123.483755:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00002000:00100000:1.0:1789024123.483777:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff90cc08783b80 x1875927402388480/t4294967321(0) o4->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:294/0 lens 504/448 e 0 to 0 dl 1789024134 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789024123.483789:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc08783b80 with x1875927402388480 ext(0->12) 00002000:00010000:1.0:1789024123.483798:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc08783b80 00000100:00100000:2.0:1789024123.498510:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.498623:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388608 00000100:00100000:1.0:1789024123.498648:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388608 00000100:00100000:1.0:1789024123.498820:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 243 00000100:00100000:1.0:1789024123.498832:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+73:12468:x1875927402388608:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789024123.506728:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1789024123.506749:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00010000:00010000:1.0:1789024123.506855:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506870:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506877:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506883:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.506888:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506896:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506911:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90cb0231ad00) 00010000:00010000:1.0:1789024123.506914:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.506935:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506942:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb434e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.506998:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507005:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507012:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507017:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.507020:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507026:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507033:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90cb0231b800) 00010000:00010000:1.0:1789024123.507036:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.507039:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507044:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5c00/0xa736ef4b98cb43f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507060:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507066:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507080:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507085:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ae00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.507088:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507095:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507104:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:1.0:1789024123.507106:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.507109:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507114:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ae00/0xa736ef4b98cb4474 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507127:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507132:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507138:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507143:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.507193:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507209:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507216:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cb0231ba00) 00010000:00010000:1.0:1789024123.507218:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.507221:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507226:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b400/0xa736ef4b98cb4497 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507243:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507248:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507253:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507258:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.507261:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507266:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507273:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.507275:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.507278:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507291:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4569 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507303:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507310:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507315:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507320:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.507323:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507328:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507336:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:1.0:1789024123.507338:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789024123.507341:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.507346:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb4626 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789024123.507538:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1789024123.507564:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cb039d99c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789024123.507568:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc025a7600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cb039d9480 00000020:00080000:2.0:1789024123.507571:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc025a7300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cc3522a600 00000004:00080000:2.0:1789024123.507599:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1789024123.507654:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789024123.509503:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024123.509527:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422355328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789024123.509596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024123.509791:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422355328 00000100:00100000:1.0:1789024123.509799:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422355328 00000100:00100000:1.0:1789024123.509867:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789024123.509877:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1875927422355328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789024123.509903:0:8904:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1789024123.509937:0:8904:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2577a, atime: 0x6aa2577b, ctime: 0x6aa2577a, blocks: 0x8 00010000:00010000:1.0:1789024123.509945:0:8904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.509960:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789024123.509978:0:8904:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024123.509985:0:8904:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510002:0:8904:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510012:0:8904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510021:0:8904:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510038:0:8904:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789024123.510193:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3642:x1875927422355328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (595us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789024123.510200:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789024123.510235:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789024123.510244:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024123.510250:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510258:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024123.510262:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510270:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510285:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510291:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc6d030/0xa736ef4b98cb4650 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.510308:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024123.510310:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024123.510311:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789024123.510340:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cc3fa7c000/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789024123.510346:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422355328:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789024123.510638:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024123.510650:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422355584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789024123.510683:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024123.510763:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024123.510774:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422355456:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789024123.510803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024123.510874:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422355584 00000100:00100000:1.0:1789024123.510880:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422355584 00000100:00100000:1.0:1789024123.510925:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422355456 00000100:00100000:1.0:1789024123.510928:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422355456 00000100:00100000:1.0:1789024123.510946:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789024123.510960:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3644:x1875927422355584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789024123.511058:0:10202:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789024123.511062:0:10202:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789024124 00002000:00010000:1.0:1789024123.511065:0:10202:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789024123.511067:0:10202:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789024123 -> 1789024124 00002000:00010000:1.0:1789024123.511069:0:10202:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789024123.511106:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3644:x1875927422355584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (423us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789024123.511112:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789024123.511131:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789024123.511137:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422355456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789024123.511174:0:10202:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1789024123.511186:0:10202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.511203:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.511212:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789024123.511215:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024123.511219:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.511245:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.511259:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 12 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.511278:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422355712:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024123.511333:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4e40 going to sleep for 11 seconds 00000004:00080000:1.0:1789024123.511361:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb040b1180/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789024123.511367:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422355584:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789024123.511493:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1789024123.512322:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cb039d9900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789024123.512330:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc35430400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cb039d9c00 00000020:00080000:2.0:1789024123.512333:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc35430b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cb03853200 00000020:00080000:2.0:1789024123.512351:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789024123.512426:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789024123.512487:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789024123.512686:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12468:x1875927402388608:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 Request processed in 13855us (14184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.512695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 243 00000100:00100000:2.0:1789024123.514324:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.514565:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388736 00000100:00100000:0.0:1789024123.514574:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388736 00010000:00010000:0.0:1789024123.514624:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 13 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.514667:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 102 00000100:00100000:0.0:1789024123.514689:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+13:2402:x1875927402388736:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024123.514703:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024123.514709:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 13 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.514723:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 13 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.514746:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789024123.514752:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789024123.514757:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.514767:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.514787:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024123.514843:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+13:2402:x1875927402388736:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 156us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.514850:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 102 00010000:00010000:1.0:1789024123.515418:0:10202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb4404 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af76b expref: 12 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.515435:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422355712:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024123.515457:0:10202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.515468:0:10202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.515475:0:10202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.515485:0:10202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.515509:0:10202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.515565:0:10202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789024123.515735:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3641:x1875927422355456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4597us (4930us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789024123.515744:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1789024123.516266:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb040b2d80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789024123.516274:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422355456:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789024123.520863:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024123.520879:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.520893:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024123.520915:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.520927:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.520949:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.520956:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001665ac3b/0xa736ef4b98cb4657 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.520995:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024123.520996:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024123.520998:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024123.521216:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.521313:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402388864 00000100:00100000:1.0:1789024123.521324:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402388864 00000100:00100000:1.0:1789024123.521374:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:1.0:1789024123.521384:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+12:2402:x1875927402388864:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789024123.523474:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1789024123.523490:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1789024123.523668:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402388864:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 Request processed in 2280us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.523678:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 76 00000100:00100000:3.0:1789024123.538853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.539570:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389120 00000100:00100000:0.0:1789024123.539581:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389120 00000100:00100000:0.0:1789024123.539659:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 244 00000100:00100000:0.0:1789024123.539670:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12468:x1875927402389120:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789024123.539735:0:13818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024123.539763:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322200/0xa736ef4b98cb463b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af805 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.539784:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:0.0:1789024123.539790:0:13818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024123.539820:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.539835:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.539845:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024123.539981:0:13818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006df43b11 reply state 000000008e75d645 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.539993:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.539999:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:0.0:1789024123.540002:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789024123.540005:0:13818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789024123.540105:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+22:12468:x1875927402389120:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 437us (1261us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789024123.540112:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 244 00000100:00100000:2.0:1789024123.551022:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.551115:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389248 00000100:00100000:1.0:1789024123.551125:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389248 00000100:00100000:1.0:1789024123.551232:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 77 00000100:00100000:1.0:1789024123.551243:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402389248:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789024123.551393:0:8904:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789024123.551397:0:8904:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789024124 -> 1789024123 00002000:00010000:1.0:1789024123.551400:0:8904:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789024123 00002000:00010000:1.0:1789024123.551402:0:8904:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789024124 -> 1789024123 00002000:00010000:1.0:1789024123.551404:0:8904:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789024123.551455:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402389248:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 214us (443us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789024123.551479:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 77 00000100:00100000:2.0:1789024123.563017:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.563102:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389504 00000100:00100000:3.0:1789024123.563113:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389504 00000100:00100000:3.0:1789024123.563208:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 245 00000100:00100000:3.0:1789024123.563218:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+22:12468:x1875927402389504:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789024123.563286:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.563302:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 22 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.563325:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.563359:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 22 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.563374:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 22 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.563388:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422355840:192.168.202.18@tcp:104: 00000100:00100000:3.0:1789024123.563478:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc35417f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024123.565536:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422355840:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024123.565562:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024123.571572:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.571692:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389632 00000100:00100000:1.0:1789024123.571702:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389632 00010000:00010000:1.0:1789024123.571741:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 23 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.571778:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 103 00000100:00100000:1.0:1789024123.571789:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+23:2402:x1875927402389632:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024123.571805:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024123.571812:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 23 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571825:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 23 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571846:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338bc00/0xa736ef4b98cb461f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7f7 expref: 23 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571863:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:1.0:1789024123.571869:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571880:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571903:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.571938:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024123.572049:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2402:x1875927402389632:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 261us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.572057:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 103 00010000:00010000:2.0:1789024123.572245:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572254:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572290:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572297:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572303:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572309:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024123.572314:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572321:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572329:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:2.0:1789024123.572332:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789024123.572336:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.572352:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338be00/0xa736ef4b98cb4665 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024123.572390:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12468:x1875927402389504:12345-192.168.202.18@tcp:55:lhsmtool_posix.0 Request processed in 9173us (9382us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789024123.572397:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 245 00000100:00100000:3.0:1789024123.579408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.580540:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389760 00000100:00100000:1.0:1789024123.580552:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389760 00000100:00100000:1.0:1789024123.580650:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 78 00000100:00100000:1.0:1789024123.580660:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2403:x1875927402389760:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789024123.580704:0:10202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.580724:0:10202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.580733:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024123.580738:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024123.580743:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.580779:0:10202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.580794:0:10202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 8 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.580823:0:10202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422355968:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024123.580906:0:10202:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024123.585214:0:10202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10202:1875927422355968:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024123.585244:0:10202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.589602:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024123.589715:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402389888 00000100:00100000:0.0:1789024123.589726:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402389888 00010000:00010000:0.0:1789024123.589771:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 9 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.589834:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 104 00000100:00100000:0.0:1789024123.589845:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+9:2402:x1875927402389888:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024123.589863:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024123.589887:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 9 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.589901:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 9 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.589925:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4649 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af813 expref: 9 pid: 8433 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.589942:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789024123.589947:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789024123.589953:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.589967:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.590002:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024123.590071:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402389888:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 228us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.590078:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 104 00010000:00010000:1.0:1789024123.590104:0:10202:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590114:0:10202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590136:0:10202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590295:0:10202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590306:0:10202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590312:0:10202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024123.590316:0:10202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590338:0:10202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590350:0:10202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.590358:0:10202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a125a296/0xa736ef4b98cb466c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.590405:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402389760:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 Request processed in 9747us (11006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024123.590413:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 78 00000100:00100000:0.0:1789024123.595065:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.595140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402390144 00000100:00100000:1.0:1789024123.595287:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402390144 00000100:00100000:1.0:1789024123.595338:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 246 00000100:00100000:1.0:1789024123.595347:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+21:12468:x1875927402390144:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789024123.595423:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.595449:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 21 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.595459:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.595494:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 21 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.595519:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 21 pid: 7824 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.595533:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356096:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024123.595624:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024123.601076:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356096:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024123.601108:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.601390:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.601534:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402390272 00000100:00100000:1.0:1789024123.601541:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402390272 00010000:00010000:1.0:1789024123.601577:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 22 pid: 7824 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.601609:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 105 00000100:00100000:1.0:1789024123.601630:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2403:x1875927402390272:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024123.601645:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024123.601652:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 22 pid: 7824 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601664:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 22 pid: 7824 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601686:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4562 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7bf expref: 22 pid: 7824 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601715:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.601721:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601730:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601738:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601746:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.601773:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024123.601818:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.601824:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+21:2403:x1875927402390272:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 197us (437us total) trans 0 rc 0/0 00010000:00010000:0.0:1789024123.601827:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.601831:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 105 00010000:00010000:0.0:1789024123.602021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.602033:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.602042:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.602079:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.602092:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 21 pid: 6515 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.602104:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356224:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024123.602190:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789024123.605204:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024123.605344:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402390400 00000100:00100000:2.0:1789024123.605353:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402390400 00010000:00010000:2.0:1789024123.605391:0:7924:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 22 pid: 6515 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024123.605431:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 106 00000100:00100000:2.0:1789024123.605441:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2402:x1875927402390400:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024123.605456:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024123.605462:0:7924:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 22 pid: 6515 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.605474:0:7924:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 22 pid: 6515 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.605492:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:2.0:1789024123.605497:0:7924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.605507:0:7924:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.605531:0:7924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.605551:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024123.605602:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2402:x1875927402390400:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 163us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024123.605610:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 106 00010000:00010000:0.0:1789024123.606873:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e000/0xa736ef4b98cb462d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7fe expref: 21 pid: 6515 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.606895:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356224:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024123.606915:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.606937:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.606944:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024123.607332:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789024123.607454:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789024123.607483:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789024123.607546:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875927422356352:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789024123.607597:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024123.607734:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4154cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024123.616214:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422356352 00000100:00100000:2.0:1789024123.616231:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422356352 00000100:00100000:2.0:1789024123.616294:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789024123.616304:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875927422356352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789024123.616440:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875927422356352:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (8840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024123.616447:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789024123.616716:0:6517:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1789024123.616724:0:6517:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:1.0:1789024123.616744:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb040b1180, transno 4294967322 00000004:00080000:1.0:1789024123.616754:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb040b2d80, transno 4294967323 00000100:00100000:1.0:1789024123.616760:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875927422356352:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789024123.616912:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789024123.617011:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875927422356480:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789024123.617052:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024123.617081:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422356480 00000100:00100000:1.0:1789024123.617085:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422356480 00000100:00100000:1.0:1789024123.617135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789024123.617142:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875927422356480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789024123.617362:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1875927422356480:12345-0@lo:1000:mdt00_002.0 Request processed in 220us (309us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789024123.617369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789024123.617395:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024123.617416:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875927422356480:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789024123.617518:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617529:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617536:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617543:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.617548:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617556:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617571:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:1.0:1789024123.617574:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024123.617579:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617585:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f200/0xa736ef4b98cb467a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617630:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617637:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617643:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617648:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.617651:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617656:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617664:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.617666:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024123.617673:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617684:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617692:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.617715:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024123.617737:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356608:192.168.202.18@tcp:105: 00000100:00100000:1.0:1789024123.617801:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789024123.622735:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024123.622735:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875927422356608:192.168.202.18@tcp:105: 00010000:00010000:1.0:1789024123.622760:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622771:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb45bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622801:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622828:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622838:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622844:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622851:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622856:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.622861:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622882:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622895:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.622898:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024123.622902:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622908:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4681 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.622919:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623083:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623090:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623096:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024123.623100:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623106:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623115:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024123.623117:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024123.623120:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024123.623135:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322c00/0xa736ef4b98cb4673 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024123.623211:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402390528 00000100:00100000:2.0:1789024123.623219:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402390528 00000100:00100000:2.0:1789024123.623266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:2.0:1789024123.623277:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12467:x1875927402390528:12345-192.168.202.18@tcp:49:lfs.0 00000100:00100000:2.0:1789024123.623405:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12467:x1875927402390528:12345-192.168.202.18@tcp:49:lfs.0 Request processed in 129us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024123.623412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:1.0:1789024123.623415:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+25:12468:x1875927402390144:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 28071us (28361us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789024123.623422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 246 00000020:00080000:1.0:1789024123.623425:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789024123.623922:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024123.623927:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024123.624441:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789024123.624571:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789024123.625689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024123.625812:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402390784 00000100:00100000:2.0:1789024123.625821:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402390784 00000100:00100000:2.0:1789024123.625873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:2.0:1789024123.625882:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+24:12468:x1875927402390784:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789024123.626192:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789024123.626237:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789024123.626270:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626286:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626297:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626305:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626312:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626317:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.626331:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789024123.626417:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12468:x1875927402390784:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 534us (743us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789024123.626424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 62 00000020:00080000:2.0:1789024123.626429:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789024123.626623:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024123.626629:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.626637:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024123.626641:0:9521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.626663:0:9521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.626675:0:9521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:3.0:1789024123.626688:0:9521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789024123.626694:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.626699:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb4688 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.626712:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024123.626714:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024123.626715:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024123.642547:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.642772:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391040 00000100:00100000:3.0:1789024123.642782:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391040 00000100:00100000:3.0:1789024123.642846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 247 00000100:00100000:3.0:1789024123.642857:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12467:x1875927402391040:12345-192.168.202.18@tcp:58:lfs.0 00000040:00080000:3.0:1789024123.643038:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789024123.643119:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12467:x1875927402391040:12345-192.168.202.18@tcp:58:lfs.0 Request processed in 263us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.643127:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 247 00000100:00100000:1.0:1789024123.675928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024123.676372:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391168 00000100:00100000:2.0:1789024123.676383:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391168 00000100:00100000:2.0:1789024123.676438:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 248 00000100:00100000:2.0:1789024123.676448:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+26:12470:x1875927402391168:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024123.676469:0:7824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024123.676490:0:7824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb468f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af81a expref: -99 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676570:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676585:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676598:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676625:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676633:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024123.676640:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.677490:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.677507:0:7824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 27 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.677515:0:7824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.677550:0:7824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 27 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.677566:0:7824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 27 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024123.677579:0:7824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422356736:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024123.677759:0:7824:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02fcd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789024123.684014:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024123.690264:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391424 00000100:00100000:2.0:1789024123.690281:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391424 00000100:00100000:2.0:1789024123.690359:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:2.0:1789024123.690372:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+28:6172:x1875927402391424:12345-192.168.202.18@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789024123.690627:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+29:6172:x1875927402391424:12345-192.168.202.18@tcp:35:ldlm_bl.0 Request processed in 257us (6619us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789024123.690634:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:1.0:1789024123.692636:0:7824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7824:1875927422356736:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024123.692667:0:7824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024123.693429:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024123.693594:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391552 00000100:00100000:3.0:1789024123.693602:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391552 00010000:00010000:3.0:1789024123.693650:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 29 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024123.693696:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:3.0:1789024123.693707:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+29:2403:x1875927402391552:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024123.693735:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024123.693744:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 29 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693757:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 29 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693779:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb45af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7db expref: 29 pid: 13818 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693794:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024123.693799:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693809:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693817:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024123.693894:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024123.693949:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+28:2403:x1875927402391552:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 244us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024123.693957:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 107 00010000:00010000:0.0:1789024123.696374:0:7824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696391:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024123.696766:0:7824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789024123.696771:0:7824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024123.696794:0:7824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696810:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696820:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696827:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696836:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696842:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024123.696847:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696854:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696870:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:0.0:1789024123.696890:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024123.696896:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696902:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb4696 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696920:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696926:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696932:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696937:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024123.696940:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696946:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696954:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90cc351ff700) 00010000:00010000:0.0:1789024123.696957:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024123.696960:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.696965:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4a00/0xa736ef4b98cb469d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.697011:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5400/0xa736ef4b98cb468f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af81a expref: 28 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.697039:0:7824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af81a expref: 27 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024123.697046:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:0.0:1789024123.697048:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789024123.697125:0:7824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024123.697547:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12470:x1875927402391168:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 21099us (21626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024123.697556:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 248 00010000:00010000:3.0:1789024123.788325:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789024123.928551:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789024123.928567:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789024124.300375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422356864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024124.300442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024124.300597:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422356864 00000100:00100000:2.0:1789024124.300616:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422356864 00000100:00100000:2.0:1789024124.300674:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789024124.300683:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422356864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024124.300706:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1789024124.300753:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422356864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024124.300760:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789024124.300806:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422356864:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789024124.300863:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024124.301019:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024124.314321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422356992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024124.314398:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024124.322873:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422356992 00000100:00100000:0.0:1789024124.322890:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422356992 00000100:00100000:0.0:1789024124.322971:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789024124.322983:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422356992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024124.323009:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789024124.323109:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422356992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (8710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024124.323117:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789024124.323428:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422356992:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789024124.686672:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024124.686681:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024124.686717:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789024124.686727:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789024124.686865:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422357120:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789024124.686956:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc22cd6780 going to sleep for 11 seconds 00000100:00100000:3.0:1789024124.696885:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875927422357120:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789024124.697142:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024124.697572:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391680 00000100:00100000:3.0:1789024124.697581:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391680 00000100:00100000:3.0:1789024124.697653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 249 00000100:00100000:3.0:1789024124.697662:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12481:x1875927402391680:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789024124.697695:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789024124.697791:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12481:x1875927402391680:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 129us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.697799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 249 00000100:00080000:2.0:1789024124.697949:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024124.708207:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024124.709265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402391936 00000100:00100000:1.0:1789024124.709277:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402391936 00000100:00100000:1.0:1789024124.709337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 250 00000100:00100000:1.0:1789024124.709347:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+27:12481:x1875927402391936:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024124.709368:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024124.709389:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb46ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af821 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.709531:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323200/0xa736ef4b98cb46b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.709547:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323200/0xa736ef4b98cb46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.709560:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323200/0xa736ef4b98cb46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024124.709572:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789024124.709695:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322800/0xa736ef4b98cb46ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af821 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.709712:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323200/0xa736ef4b98cb46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af821 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.709721:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024124.709724:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024124.709729:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323200, rc 0) 00000100:00100000:1.0:1789024124.709794:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+29:12481:x1875927402391936:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 448us (1596us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789024124.709802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 250 00000100:00100000:1.0:1789024124.718991:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024124.719054:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024124.719326:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392320 00000100:00100000:3.0:1789024124.719336:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392320 00000100:00100000:3.0:1789024124.719398:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:3.0:1789024124.719408:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+29:2400:x1875927402392320:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024124.719423:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024124.719447:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323200/0xa736ef4b98cb46b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af821 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024124.719462:0:7924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024124.719467:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024124.719518:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+28:2400:x1875927402392320:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 112us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.719526:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:2.0:1789024124.720557:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392192 00000100:00100000:2.0:1789024124.720565:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392192 00000100:00100000:2.0:1789024124.720624:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 251 00000100:00100000:2.0:1789024124.720633:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+28:12481:x1875927402392192:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789024124.720702:0:7824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720717:0:7824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720728:0:7824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720868:0:7824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720877:0:7824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720896:0:7824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720903:0:7824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024124.720908:0:7824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720917:0:7824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720927:0:7824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:2.0:1789024124.720930:0:7824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789024124.720934:0:7824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.720940:0:7824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024124.721363:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+29:12481:x1875927402392192:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 729us (2377us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789024124.721372:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 251 00000100:00100000:1.0:1789024124.731012:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024124.731725:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392576 00000100:00100000:3.0:1789024124.731735:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392576 00000100:00100000:3.0:1789024124.731792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:3.0:1789024124.731803:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+29:12481:x1875927402392576:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789024124.732192:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+30:12481:x1875927402392576:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 390us (1187us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789024124.732200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00000040:00080000:3.0:1789024124.734331:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789024124.734339:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024124.738375:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789024124.738394:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789024124.783545:0:14760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789024124.783554:0:14760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789024124.783583:0:14760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789024124.783588:0:14760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789024124.813141:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024124.813197:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422357248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024124.813268:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.813377:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357248 00000100:00100000:3.0:1789024124.813385:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357248 00000100:00100000:3.0:1789024124.813431:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789024124.813440:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422357248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024124.813470:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024124.813514:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422357248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.813521:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00010000:3.0:1789024124.813541:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024124.813563:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789024124.813569:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1789024124.813587:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cb021e1880, transno 4294967308 00000004:00080000:3.0:1789024124.813597:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1789024124.813632:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90cc3fa7c000, transno 4294967311 00000100:00100000:3.0:1789024124.813645:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422357248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024124.814399:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024124.814412:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422357376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024124.814458:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.814527:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357376 00000100:00100000:3.0:1789024124.814532:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357376 00000100:00100000:3.0:1789024124.814580:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789024124.814588:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422357376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024124.814614:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024124.814652:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422357376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.814658:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789024124.814690:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422357376:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789024124.814782:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024124.820831:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422357504:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.820904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.820946:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422358016:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.820975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.820992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422358528:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821010:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821030:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789024124.821035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422357888:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821051:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422358400:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821078:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821101:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358528 00000100:00100000:3.0:1789024124.821107:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358528 00000100:00100000:3.0:1789024124.821175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357888 00000100:00100000:3.0:1789024124.821189:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357888 00000100:00100000:3.0:1789024124.821209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358400 00000100:00100000:3.0:1789024124.821212:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358400 00000100:00100000:3.0:1789024124.821226:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789024124.821233:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422358528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821276:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422358528:12345-0@lo:400:kworker.0 Request processed in 44us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789024124.821296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789024124.821301:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422357888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821320:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422357888:12345-0@lo:400:kworker.0 Request processed in 20us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789024124.821334:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789024124.821339:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422358400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821357:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422358400:12345-0@lo:400:kworker.0 Request processed in 19us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821362:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:3.0:1789024124.821379:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024124.821383:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024124.821396:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422357632:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821429:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422358144:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821455:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789024124.821459:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422357760:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821485:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821499:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422358272:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024124.821530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358016 00000100:00100000:3.0:1789024124.821533:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358016 00000100:00100000:3.0:1789024124.821552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357760 00000100:00100000:3.0:1789024124.821554:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357760 00000100:00100000:3.0:1789024124.821564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789024124.821568:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422358016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821594:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422358016:12345-0@lo:400:kworker.0 Request processed in 25us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789024124.821625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789024124.821630:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422357760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821655:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422357760:12345-0@lo:400:kworker.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789024124.821676:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357632 00000100:00100000:3.0:1789024124.821679:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357632 00000100:00100000:3.0:1789024124.821693:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358144 00000100:00100000:3.0:1789024124.821695:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358144 00000100:00100000:3.0:1789024124.821708:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358272 00000100:00100000:3.0:1789024124.821710:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358272 00000100:00100000:3.0:1789024124.821720:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789024124.821725:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422357632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821748:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422357632:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821761:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789024124.821771:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789024124.821776:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422358144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821797:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422358144:12345-0@lo:400:kworker.0 Request processed in 22us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821802:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789024124.821810:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789024124.821815:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422358272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821834:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422358272:12345-0@lo:400:kworker.0 Request processed in 19us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.821839:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:3.0:1789024124.821855:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024124.821857:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024124.821879:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422357888:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821888:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422358400:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422358016:0@lo:400:kworker.0 00010000:00080000:3.0:1789024124.821906:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3faeb100 x1875927422358528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024124.821915:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422358528:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821936:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422357760:0@lo:400:kworker.0 00010000:00080000:3.0:1789024124.821944:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3faeb800 x1875927422358272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024124.821951:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422358272:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422357632:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.821971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422358144:0@lo:400:kworker.0 00000100:00100000:1.0:1789024124.822266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422357504 00000100:00100000:1.0:1789024124.822271:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422357504 00000100:00100000:1.0:1789024124.822300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789024124.822306:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024124.822339:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3644:x1875927422357504:12345-0@lo:400:kworker.0 Request processed in 34us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024124.822345:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789024124.822432:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422357504:0@lo:400:kworker.0 00000100:00100000:3.0:1789024124.948376:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.948575:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392704 00000100:00100000:2.0:1789024124.948585:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392704 00000100:00100000:2.0:1789024124.948815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 394 00000100:00100000:2.0:1789024124.948827:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402392704:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024124.949200:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402392704:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 374us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024124.949208:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 394 00000100:00100000:2.0:1789024124.954269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024124.956266:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392832 00000100:00100000:1.0:1789024124.956521:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392832 00000100:00080000:3.0:1789024124.956656:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024124.957557:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 346 00000100:00100000:1.0:1789024124.957572:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402392832:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024124.957678:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402392832:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 111us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024124.957685:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 346 00000100:00100000:2.0:1789024124.978092:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.978127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.978176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.978210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.978238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393216 00000100:00100000:2.0:1789024124.978249:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393216 00000100:00100000:2.0:1789024124.978309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393344 00000100:00100000:2.0:1789024124.978313:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393344 00000100:00100000:2.0:1789024124.978338:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 347 00000100:00100000:2.0:1789024124.978350:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402393216:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024124.978425:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402393216:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024124.978433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 347 00000100:00100000:2.0:1789024124.978465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 348 00000100:00100000:2.0:1789024124.978472:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402393344:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024124.978496:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402393344:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024124.978502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 348 00000100:00080000:2.0:1789024124.978521:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024124.978525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024124.978800:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402392960 00000100:00100000:3.0:1789024124.978805:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402392960 00000100:00100000:3.0:1789024124.978842:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393088 00000100:00100000:3.0:1789024124.978845:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393088 00000100:00100000:3.0:1789024124.978870:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 103 00000100:00100000:3.0:1789024124.978877:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402392960:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024124.978914:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402392960:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 38us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.978922:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 103 00000100:00100000:3.0:1789024124.978934:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 104 00000100:00100000:3.0:1789024124.978942:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402393088:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024124.978964:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402393088:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024124.978970:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 104 00000100:00080000:2.0:1789024124.979070:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024124.985868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024124.985966:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393600 00000100:00100000:1.0:1789024124.985978:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393600 00000100:00100000:1.0:1789024124.986037:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 252 00000100:00100000:1.0:1789024124.986048:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+30:12494:x1875927402393600:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:1.0:1789024124.986071:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024124.986092:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb46c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af828 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.986221:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb46ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.986246:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb46ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.986259:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb46ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024124.986272:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789024124.986372:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323e00/0xa736ef4b98cb46c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af828 expref: 33 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.986387:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb46ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af828 expref: 32 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024124.986396:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:1.0:1789024124.986398:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789024124.986402:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322000, rc 0) 00000100:00100000:1.0:1789024124.986461:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+32:12494:x1875927402393600:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 416us (603us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789024124.986469:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 252 00000100:00100000:1.0:1789024124.990200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024124.990260:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393728 00000100:00100000:2.0:1789024124.990270:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393728 00000100:00100000:2.0:1789024124.990320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 253 00000100:00100000:2.0:1789024124.990329:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+32:12494:x1875927402393728:12345-192.168.202.18@tcp:54:lfs.0 00010000:00010000:2.0:1789024124.990394:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990410:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990421:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990466:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990473:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990480:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990486:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024124.990489:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990497:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990507:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:2.0:1789024124.990510:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024124.990522:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024124.990528:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c4200/0xa736ef4b98cb46dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024124.990633:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+32:12494:x1875927402393728:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 305us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024124.990639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 253 00000100:00100000:2.0:1789024125.079517:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024125.079632:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393856 00000100:00100000:1.0:1789024125.079643:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393856 00000100:00100000:1.0:1789024125.079716:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 79 00000100:00100000:1.0:1789024125.079727:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402393856:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:1.0:1789024125.079746:0:10202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024125.079768:0:10202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2a9e14/0xa736ef4b98cb46e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af82f expref: -99 pid: 10202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024125.079811:0:10202:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa2577b, atime: 0x6aa2577b, ctime: 0x6aa2577b, blocks: 0x8 00010000:00010000:1.0:1789024125.079831:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1789024125.079836:0:10202:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024125.079845:0:10202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2a9e14/0xa736ef4b98cb46e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af82f expref: 8 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024125.079873:0:10202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce2a9e14/0xa736ef4b98cb46e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af82f expref: 8 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024125.079887:0:10202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323e00, rc 0) 00000100:00100000:1.0:1789024125.079956:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2402:x1875927402393856:12345-192.168.202.18@tcp:101:cat.0 Request processed in 223us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024125.079964:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 79 00000100:00080000:2.0:1789024125.080127:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024125.084232:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024125.084774:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402393984 00000100:00100000:3.0:1789024125.084785:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402393984 00002000:00100000:3.0:1789024125.084838:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff90cc3faebb80 x1875927402393984/t0(0) o3->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:296/0 lens 488/0 e 0 to 0 dl 1789024136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789024125.084849:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3faebb80 with x1875927402393984 ext(0->4095) 00002000:00010000:3.0:1789024125.084868:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3faebb80 00000100:00100000:3.0:1789024125.084964:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:3.0:1789024125.084975:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2400:x1875927402393984:12345-192.168.202.18@tcp:3:cat.0 00000100:00100000:3.0:1789024125.085142:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+8:2400:x1875927402393984:12345-192.168.202.18@tcp:3:cat.0 Request processed in 169us (918us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789024125.085177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00002000:00100000:3.0:1789024125.085184:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff90cc3faebb80 x1875927402393984/t0(0) o3->382f7d83-ada1-4b7e-b952-8068d9fee082@192.168.202.18@tcp:296/0 lens 488/4536 e 0 to 0 dl 1789024136 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789024125.085192:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90cc3faebb80 with x1875927402393984 ext(0->4095) 00002000:00010000:3.0:1789024125.085196:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90cc3faebb80 00010000:00010000:3.0:1789024125.836988:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024126.348967:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422358656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024126.349041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024126.350276:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358656 00000100:00100000:1.0:1789024126.350288:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358656 00000100:00100000:1.0:1789024126.350348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789024126.350358:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422358656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024126.350399:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789024126.350478:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422358656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024126.350485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789024126.351697:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422358656:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024126.863554:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789024127.308845:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789024127.820832:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789024127.820847:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789024127.821342:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789024127.821355:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789024127.886257:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024128.396798:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024128.396822:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422358784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024128.396904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024128.396983:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358784 00000100:00100000:1.0:1789024128.396992:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358784 00000100:00100000:1.0:1789024128.397039:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789024128.397048:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422358784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024128.397084:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789024128.397133:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422358784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024128.397140:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789024128.397216:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422358784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789024128.909893:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789024128.921386:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1789024128.921404:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1789024128.921770:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789024128.921936:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90cc04df4a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789024128.921944:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc19ef8200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90cc04df43c0 00000020:00080000:2.0:1789024128.921948:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90cc19ef8800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90cb03337c00 00000020:00080000:2.0:1789024128.921982:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789024128.923135:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789024128.923274:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789024128.925175:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925209:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925219:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925255:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024128.925261:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925270:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925294:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90cb0231b400) 00010000:00010000:0.0:1789024128.925298:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024128.925304:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024128.925311:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e400/0xa736ef4b98cb465e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024129.420680:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422358912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024129.420796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024129.422656:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024129.422679:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422359040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024129.422748:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024129.422846:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422358912 00000100:00100000:2.0:1789024129.422858:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422358912 00000100:00100000:2.0:1789024129.422931:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359040 00000100:00100000:2.0:1789024129.422935:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359040 00000100:00100000:2.0:1789024129.422973:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789024129.422984:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422358912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024129.423024:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789024129.423082:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422358912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.423111:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789024129.423133:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789024129.423140:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422359040:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789024129.423365:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024129.423435:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422358912:0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024129.423677:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789024129.423729:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422359040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 588us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.423736:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789024129.424289:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1789024129.424298:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1789024129.424325:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422359040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789024129.934753:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.934842:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024129.934997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422359168:0@lo:400:kworker.0 00000100:00100000:1.0:1789024129.935034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.935089:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422359296:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.935121:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.935173:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359424 00000100:00100000:0.0:1789024129.935181:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359424 00000100:00100000:0.0:1789024129.935233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789024129.935241:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422359424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.935293:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422359424:12345-0@lo:400:kworker.0 Request processed in 52us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.935300:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789024129.935322:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359296 00000100:00100000:0.0:1789024129.935326:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359296 00000100:00100000:0.0:1789024129.935353:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789024129.935360:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422359296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.935406:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422359296:12345-0@lo:400:kworker.0 Request processed in 47us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.935412:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789024129.936867:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.936883:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422359936:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.936945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024129.936998:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422359552:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.937026:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024129.937056:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359936 00000100:00100000:2.0:1789024129.937062:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359936 00010000:00010000:3.0:1789024129.937323:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024129.940486:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422359296:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.940504:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422359808:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.940572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024129.943194:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422359680:0@lo:400:kworker.0 00000100:00100000:1.0:1789024129.943274:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024129.943303:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422360192:0@lo:400:kworker.0 00000100:00100000:1.0:1789024129.943343:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359680 00000100:00100000:1.0:1789024129.943351:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359680 00000100:00100000:1.0:1789024129.943406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789024129.943414:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422359680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024129.943484:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422359680:12345-0@lo:400:kworker.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024129.943491:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789024129.957302:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422360320:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.957373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.957408:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360320 00000100:00100000:0.0:1789024129.957417:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360320 00000100:00100000:0.0:1789024129.960310:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789024129.960332:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422360320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.960426:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422360320:12345-0@lo:400:kworker.0 Request processed in 104us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.960434:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789024129.960503:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422360448:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.960537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.960592:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024129.960599:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422360576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024129.960624:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.960657:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360448 00000100:00100000:0.0:1789024129.960664:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360448 00000100:00100000:0.0:1789024129.960703:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789024129.960708:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422360448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.960743:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422360448:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.960764:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789024129.960788:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422360064:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.960814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024129.961709:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359552 00000100:00100000:2.0:1789024129.961716:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359552 00000100:00100000:2.0:1789024129.961760:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359808 00000100:00100000:2.0:1789024129.961764:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359808 00000100:00100000:2.0:1789024129.961785:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789024129.961793:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422359936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.961842:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422359936:12345-0@lo:400:kworker.0 Request processed in 51us (24897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.961849:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789024129.964712:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789024129.964727:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.964817:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422359552:12345-0@lo:400:kworker.0 Request processed in 96us (27789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.964824:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789024129.964838:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789024129.964846:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422359808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.964890:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422359808:12345-0@lo:400:kworker.0 Request processed in 46us (24318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.964896:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:2.0:1789024129.966964:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024129.966973:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024129.966976:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024129.967016:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422359168 00000100:00100000:2.0:1789024129.967026:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422359168 00000100:00100000:2.0:1789024129.967073:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789024129.967081:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422359168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.967177:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422359168:12345-0@lo:400:kworker.0 Request processed in 66us (32110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.967183:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789024129.967386:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422360320:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.967418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422359808:0@lo:400:kworker.0 00000100:00100000:2.0:1789024129.967427:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789024129.967435:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422360704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024129.967492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024129.967527:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360576 00000100:00100000:2.0:1789024129.967542:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360576 00000100:00100000:2.0:1789024129.967583:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360704 00000100:00100000:2.0:1789024129.967586:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360704 00000100:00100000:2.0:1789024129.967597:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789024129.967602:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422360576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024129.967626:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024129.967655:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422360576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (7031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.967661:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789024129.967670:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789024129.967675:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422360704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024129.967682:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024129.967702:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422360704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024129.967707:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789024129.967732:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422360704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024129.969513:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422360576:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789024129.969540:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ef800 x1875927422359936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024129.969559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422359936:0@lo:400:kworker.0 00000100:00100000:3.0:1789024129.969590:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422360448:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.976770:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024129.976845:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422359168:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.976874:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422359680:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.976919:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360064 00000100:00100000:0.0:1789024129.976928:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360064 00000100:00100000:0.0:1789024129.976986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360192 00000100:00100000:0.0:1789024129.976990:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360192 00000100:00100000:0.0:1789024129.977015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789024129.977022:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422360064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.977086:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422360064:12345-0@lo:400:kworker.0 Request processed in 65us (16271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.977093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789024129.977111:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789024129.977117:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422360192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.977191:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422360192:12345-0@lo:400:kworker.0 Request processed in 74us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024129.977198:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:0.0:1789024129.977214:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024129.977217:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789024129.977235:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ed500 x1875927422360192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024129.977245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422360192:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.977294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422360064:0@lo:400:kworker.0 00000100:00100000:0.0:1789024129.977313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422359552:0@lo:400:kworker.0 00000100:00100000:2.0:1789024130.093793:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.093834:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.093867:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.093900:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394624 00000100:00100000:2.0:1789024130.093910:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394624 00000100:00100000:2.0:1789024130.093971:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:2.0:1789024130.093981:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402394624:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024130.094055:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402394624:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024130.094062:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 107 00000100:00100000:2.0:1789024130.094112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.094258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00080000:0.0:1789024130.094529:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024130.094608:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394112 00000100:00100000:3.0:1789024130.094613:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394112 00000100:00100000:3.0:1789024130.094654:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 396 00000100:00100000:3.0:1789024130.094662:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402394112:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024130.094700:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14ec32b5-f959-4605-b464-02aeac6020b2+13:2402:x1875927402394112:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 39us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024130.094707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 396 00000100:00100000:2.0:1789024130.095618:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.095645:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024130.098109:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394496 00000100:00100000:2.0:1789024130.098124:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394496 00000100:00100000:2.0:1789024130.098209:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:2.0:1789024130.098221:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402394496:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024130.098307:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2402:x1875927402394496:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 88us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024130.098315:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 108 00000100:00100000:0.0:1789024130.100116:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394368 00000100:00100000:0.0:1789024130.100129:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394368 00000100:00080000:1.0:1789024130.100200:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024130.100337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394880 00000100:00100000:0.0:1789024130.100343:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394880 00000100:00100000:3.0:1789024130.100475:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394240 00000100:00100000:3.0:1789024130.100481:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394240 00000100:00100000:2.0:1789024130.104973:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402394752 00000100:00100000:2.0:1789024130.104989:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402394752 00000100:00080000:1.0:1789024130.107733:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024130.107744:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024130.109934:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 355 00000100:00100000:0.0:1789024130.109951:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402394368:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024130.110070:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2402:x1875927402394368:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 124us (16235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024130.110078:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 355 00000100:00100000:0.0:1789024130.110098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 356 00000100:00100000:0.0:1789024130.110104:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402394880:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024130.110124:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402394880:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 21us (16013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024130.110130:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 356 00000100:00100000:3.0:1789024130.113374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 357 00000100:00100000:3.0:1789024130.113390:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402394240:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024130.113472:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2402:x1875927402394240:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 87us (19214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024130.113480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 357 00000100:00100000:2.0:1789024130.116366:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 358 00000100:00100000:2.0:1789024130.116380:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402394752:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024130.116454:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2402:x1875927402394752:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 78us (20808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024130.116461:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 358 00010000:00010000:3.0:1789024130.956661:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024131.144893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024131.149622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395008 00000100:00100000:0.0:1789024131.149639:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395008 00000100:00100000:0.0:1789024131.149722:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 254 00000100:00100000:0.0:1789024131.149735:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:12156:x1875927402395008:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789024131.149864:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:12156:x1875927402395008:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 Request processed in 132us (4984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024131.149872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 254 00000100:00100000:2.0:1789024131.160776:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024131.162796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395136 00000100:00100000:3.0:1789024131.162816:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395136 00000100:00100000:3.0:1789024131.162902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 255 00000100:00100000:3.0:1789024131.162913:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:12156:x1875927402395136:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789024131.163036:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:12156:x1875927402395136:12345-192.168.202.18@tcp:60:lhsmtool_posix.0 Request processed in 125us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024131.163043:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 255 00000100:00100000:2.0:1789024131.168808:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024131.168891:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395392 00000100:00100000:1.0:1789024131.168901:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395392 00000100:00100000:1.0:1789024131.168963:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:1.0:1789024131.168974:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:12156:x1875927402395392:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789024131.169384:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:12156:x1875927402395392:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 410us (586us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789024131.169392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:0.0:1789024131.468595:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024131.468619:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422360832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024131.468694:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024131.469185:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360832 00000100:00100000:1.0:1789024131.469194:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360832 00000100:00100000:1.0:1789024131.469257:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789024131.469268:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422360832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024131.469311:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789024131.469368:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422360832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024131.469400:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789024131.469716:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422360832:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024131.980443:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024133.004418:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789024133.479579:0:14957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:08:52 (1789024132) 00000100:00100000:0.0:1789024133.518865:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024133.519426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422360960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024133.520117:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024133.520505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422360960 00000100:00100000:2.0:1789024133.520531:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422360960 00000100:00100000:3.0:1789024133.521678:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789024133.521695:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422360960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024133.521748:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024133.521839:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422360960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024133.521846:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789024133.525714:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb040b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422360960:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024134.029321:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024134.541345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422361088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024134.541424:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024134.541524:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361088 00000100:00100000:1.0:1789024134.541532:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361088 00000100:00100000:1.0:1789024134.541589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789024134.541598:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422361088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789024134.541627:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789024134.541672:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422361088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024134.541679:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789024134.541706:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024134.541740:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422361088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024134.541871:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024134.541881:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422361216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024134.541913:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024134.541942:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361216 00000100:00100000:3.0:1789024134.541946:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361216 00000100:00100000:3.0:1789024134.541979:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789024134.541985:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422361216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024134.541995:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789024134.542025:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422361216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024134.542030:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789024134.542046:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024134.542066:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422361216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024135.052554:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422361344:0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.052634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024135.053177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422361856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024135.053212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024135.053281:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789024135.053288:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422361728:0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.053313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054006:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422362240:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054064:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422362752:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054125:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789024135.054131:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422362368:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054174:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054194:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422362880:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054238:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422361472:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054277:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422361984:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054298:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054314:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422362496:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054331:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054348:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789024135.054354:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422361600:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422362112:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054411:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.054425:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422362624:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.054441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024135.054659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361344 00000100:00100000:3.0:1789024135.054669:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361344 00000100:00100000:3.0:1789024135.054715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789024135.054724:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422361344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.054780:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2a60d918-c836-4e5c-bd08-febd347ea726+24:3642:x1875927422361344:12345-0@lo:400:kworker.0 Request processed in 58us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.054795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789024135.055062:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361728 00000100:00100000:3.0:1789024135.055068:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361728 00000100:00100000:3.0:1789024135.055090:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362240 00000100:00100000:3.0:1789024135.055093:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362240 00000100:00100000:3.0:1789024135.055110:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362752 00000100:00100000:3.0:1789024135.055112:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362752 00000100:00100000:3.0:1789024135.055122:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361472 00000100:00100000:3.0:1789024135.055124:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361472 00000100:00100000:3.0:1789024135.055132:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362112 00000100:00100000:3.0:1789024135.055134:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362112 00000100:00100000:3.0:1789024135.055142:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362624 00000100:00100000:3.0:1789024135.055161:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362624 00000100:00100000:3.0:1789024135.055177:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789024135.055183:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422361728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055220:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422361728:12345-0@lo:400:kworker.0 Request processed in 37us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055225:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789024135.055236:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789024135.055242:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422362240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055268:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422362240:12345-0@lo:400:kworker.0 Request processed in 27us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055274:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789024135.055284:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789024135.055289:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055312:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422362752:12345-0@lo:400:kworker.0 Request processed in 23us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055316:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789024135.055333:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789024135.055338:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422361472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055362:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422361472:12345-0@lo:400:kworker.0 Request processed in 25us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055367:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789024135.055375:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789024135.055380:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422362112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055402:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422362112:12345-0@lo:400:kworker.0 Request processed in 22us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055407:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789024135.055416:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789024135.055420:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422362624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.055440:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875927422362624:12345-0@lo:400:kworker.0 Request processed in 20us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.055445:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789024135.055462:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362368 00000100:00100000:3.0:1789024135.055466:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362368 00000100:00100000:1.0:1789024135.055682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422361728:0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.055693:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422361344:0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.056983:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361984 00000100:00100000:1.0:1789024135.056991:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361984 00000100:00100000:1.0:1789024135.057043:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361600 00000100:00100000:1.0:1789024135.057045:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361600 00000100:00100000:1.0:1789024135.057056:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789024135.057061:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422361984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.057123:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422361984:12345-0@lo:400:kworker.0 Request processed in 62us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.057127:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789024135.057158:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789024135.057162:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422361600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.057181:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422361600:12345-0@lo:400:kworker.0 Request processed in 19us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.057184:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789024135.057197:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362880 00000100:00100000:1.0:1789024135.057200:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362880 00000100:00100000:1.0:1789024135.057217:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422362496 00000100:00100000:1.0:1789024135.057219:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422362496 00000100:00100000:1.0:1789024135.057231:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024135.057235:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422362880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.057253:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422362880:12345-0@lo:400:kworker.0 Request processed in 19us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.057257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024135.057264:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024135.057267:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422362496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024135.057281:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422362496:12345-0@lo:400:kworker.0 Request processed in 14us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.057284:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789024135.058210:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789024135.058220:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422362368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.058282:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422362368:12345-0@lo:400:kworker.0 Request processed in 65us (4108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.058289:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:3.0:1789024135.058318:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789024135.058327:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789024135.058332:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024135.058335:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024135.058383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024135.058431:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024135.059234:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422362368:0@lo:400:kworker.0 00000100:00100000:2.0:1789024135.059248:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422362880:0@lo:400:kworker.0 00010000:00080000:2.0:1789024135.059263:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc08781180 x1875927422362240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024135.059273:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422362240:0@lo:400:kworker.0 00010000:00080000:2.0:1789024135.059296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9fdc00 x1875927422362752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024135.059304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422362752:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059439:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422361600:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059451:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422362112:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875927422362624:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059484:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422361472:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059495:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422361984:0@lo:400:kworker.0 00000100:00100000:3.0:1789024135.059518:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422362496:0@lo:400:kworker.0 00000100:00100000:0.0:1789024135.060009:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422361856 00000100:00100000:0.0:1789024135.060018:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422361856 00000100:00100000:2.0:1789024135.060110:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363008 00000100:00100000:2.0:1789024135.060115:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363008 00000100:00100000:2.0:1789024135.060235:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789024135.060246:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024135.060278:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789024135.060395:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024135.060402:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789024135.060868:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789024135.060900:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422361856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024135.060913:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789024135.060958:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422361856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (7744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.060963:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789024135.061016:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422361856:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789024135.061247:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789024135.061630:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789024135.061640:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789024135.061706:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789024135.061717:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789024135.061803:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024135.195227:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024135.195265:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024135.195287:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024135.195291:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395520 00000100:00100000:3.0:1789024135.195302:0:6509:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395520 00000100:00100000:1.0:1789024135.195304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024135.195319:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024135.195334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024135.195346:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 398 00000100:00100000:1.0:1789024135.195353:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024135.195356:0:6509:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402395520:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024135.195372:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396032 00000100:00100000:1.0:1789024135.195377:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396032 00000100:00100000:1.0:1789024135.195409:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395904 00000100:00100000:1.0:1789024135.195412:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395904 00000100:00100000:3.0:1789024135.195424:0:6509:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3128bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14ec32b5-f959-4605-b464-02aeac6020b2+13:2403:x1875927402395520:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 69us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.195431:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 112 00000100:00100000:3.0:1789024135.195432:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 398 00000100:00100000:1.0:1789024135.195437:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402396032:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024135.195461:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395776 00000100:00100000:3.0:1789024135.195464:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395776 00000100:00100000:1.0:1789024135.195464:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402396032:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.195470:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 112 00000100:00100000:1.0:1789024135.195491:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 113 00000100:00100000:1.0:1789024135.195498:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402395904:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024135.195516:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396288 00000100:00100000:3.0:1789024135.195519:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396288 00000100:00100000:3.0:1789024135.195533:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402395648 00000100:00100000:1.0:1789024135.195534:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2403:x1875927402395904:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.195535:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402395648 00000100:00100000:3.0:1789024135.195547:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396160 00000100:00100000:1.0:1789024135.195547:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 113 00000100:00100000:3.0:1789024135.195549:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396160 00000100:00100000:1.0:1789024135.195569:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 365 00000100:00100000:1.0:1789024135.195575:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402395776:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024135.196050:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2403:x1875927402395776:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 474us (783us total) trans 0 rc 0/0 00000100:00080000:2.0:1789024135.204294:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024135.204303:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024135.204306:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789024135.204309:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024135.206081:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 366 00000100:00100000:1.0:1789024135.206093:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 365 00000100:00100000:3.0:1789024135.206104:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402396288:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024135.206125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 367 00000100:00100000:1.0:1789024135.206133:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2403:x1875927402395648:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024135.206209:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402396288:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 113us (10902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.206216:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 366 00000100:00100000:0.0:1789024135.206237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 368 00000100:00100000:0.0:1789024135.206246:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402396160:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024135.206299:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+18:2403:x1875927402395648:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 167us (10977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024135.206306:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 367 00000100:00100000:0.0:1789024135.209497:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2403:x1875927402396160:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 3241us (14130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024135.209523:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 368 00000100:00100000:2.0:1789024135.747747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024135.747877:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396416 00000100:00100000:3.0:1789024135.747888:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396416 00000100:00100000:3.0:1789024135.747955:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 256 00000100:00100000:3.0:1789024135.747966:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:13167:x1875927402396416:12345-192.168.202.18@tcp:101:lsof.0 00010000:00010000:3.0:1789024135.747988:0:13818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024135.748010:0:13818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb46ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af836 expref: -99 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748078:0:13818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748092:0:13818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748102:0:13818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024135.748212:0:13818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024135.748217:0:13818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024135.748262:0:13818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748288:0:13818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b600/0xa736ef4b98cb46ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af836 expref: 7 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748323:0:13818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af836 expref: 6 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024135.748331:0:13818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:3.0:1789024135.748334:0:13818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024135.748338:0:13818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a800, rc 0) 00000100:00100000:3.0:1789024135.748403:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:13167:x1875927402396416:12345-192.168.202.18@tcp:101:lsof.0 Request processed in 439us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024135.748410:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 256 00010000:00010000:3.0:1789024136.076788:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024136.588734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024136.588756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024136.588826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024136.589137:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363136 00000100:00100000:1.0:1789024136.589168:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363136 00000100:00100000:1.0:1789024136.589224:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789024136.589234:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024136.589269:0:7823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789024136.589330:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024136.589337:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789024136.589650:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363136:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789024137.036363:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789024137.036372:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789024137.036508:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789024137.036516:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789024137.100328:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789024137.551367:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789024138.116104:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024138.116464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396672 00000100:00100000:1.0:1789024138.116484:0:6518:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396672 00000100:00100000:1.0:1789024138.116562:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 66 00000100:00100000:1.0:1789024138.116573:0:6518:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+18:13169:x1875927402396672:12345-192.168.202.18@tcp:35:umount.0 00000100:00080000:2.0:1789024138.116633:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024138.117237:0:6518:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+19:13169:x1875927402396672:12345-192.168.202.18@tcp:35:umount.0 Request processed in 664us (1141us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789024138.117261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 66 00010000:00010000:2.0:1789024138.124392:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024138.128411:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024138.128508:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402396928 00000100:00100000:3.0:1789024138.128519:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402396928 00000100:00100000:3.0:1789024138.128577:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:3.0:1789024138.128588:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+19:13169:x1875927402396928:12345-192.168.202.18@tcp:35:umount.0 00000100:00100000:3.0:1789024138.128925:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:13169:x1875927402396928:12345-192.168.202.18@tcp:35:umount.0 Request processed in 337us (522us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789024138.128933:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 67 00000100:00100000:2.0:1789024138.155493:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024138.155631:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397184 00000100:00100000:3.0:1789024138.155642:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397184 00000100:00100000:3.0:1789024138.155695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:3.0:1789024138.155705:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc339b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+20:13169:x1875927402397184:12345-192.168.202.18@tcp:35:umount.0 00000100:00100000:3.0:1789024138.155932:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc339b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+21:13169:x1875927402397184:12345-192.168.202.18@tcp:35:umount.0 Request processed in 227us (463us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789024138.155952:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 68 00000100:00100000:0.0:1789024138.167780:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024138.168014:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397440 00000100:00100000:3.0:1789024138.168024:0:6519:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397440 00000100:00100000:3.0:1789024138.168083:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:3.0:1789024138.168093:0:6519:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+21:13169:x1875927402397440:12345-192.168.202.18@tcp:35:umount.0 00000100:00100000:3.0:1789024138.168410:0:6519:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+22:13169:x1875927402397440:12345-192.168.202.18@tcp:35:umount.0 Request processed in 317us (639us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789024138.168418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 69 00000100:00100000:2.0:1789024138.178560:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024138.178598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024138.178643:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024138.178716:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397568 00000100:00100000:3.0:1789024138.178728:0:7924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397696 00000100:00100000:0.0:1789024138.178728:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397568 00000100:00100000:3.0:1789024138.178735:0:7924:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397696 00000100:00100000:0.0:1789024138.178853:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397824 00000100:00100000:0.0:1789024138.178857:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397824 00000100:00100000:3.0:1789024138.192089:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:3.0:1789024138.192111:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+15:2400:x1875927402397568:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024138.192130:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024138.192166:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb3658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af390 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.192183:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024138.192258:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+14:2400:x1875927402397568:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 156us (13708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024138.192266:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:3.0:1789024138.192289:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:3.0:1789024138.192296:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+13:2401:x1875927402397696:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024138.192306:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024138.192316:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0000/0xa736ef4b98cb3619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af351 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.192343:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024138.192363:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+12:2401:x1875927402397696:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 68us (13764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024138.192370:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:3.0:1789024138.192386:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024138.192393:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+11:2400:x1875927402397824:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024138.192400:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024138.192410:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489a00/0xa736ef4b98cb3929 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af469 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.192419:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024138.192436:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+10:2400:x1875927402397824:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 44us (13794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024138.192443:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024138.192589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024138.192840:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402397952 00000100:00100000:0.0:1789024138.192850:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402397952 00000100:00100000:0.0:1789024138.192900:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 80 00000100:00100000:0.0:1789024138.192908:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402397952:12345-192.168.202.18@tcp:9:umount.0 00000020:00000080:0.0:1789024138.192934:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb39f4 00000100:00080000:0.0:1789024138.192944:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90cc3544f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024138.193002:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789024138.193166:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:382f7d83-ada1-4b7e-b952-8068d9fee082+2:2399:x1875927402397952:12345-192.168.202.18@tcp:9:umount.0 Request processed in 239us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024138.193175:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 80 00000100:00080000:0.0:1789024138.193199:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789024138.193249:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024138.206894:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024138.208654:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402398336 00000100:00100000:2.0:1789024138.208669:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402398336 00000100:00080000:0.0:1789024138.208808:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024138.208855:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 81 00000100:00100000:2.0:1789024138.208868:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+7:2399:x1875927402398336:12345-192.168.202.18@tcp:9:umount.0 00000020:00000080:2.0:1789024138.208899:0:10202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3c6a 00000020:00010000:2.0:1789024138.208908:0:10202:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90cb0395f800: total 0 00000100:00080000:2.0:1789024138.208913:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cc1b297800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789024138.208963:0:10202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1789024138.209188:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402398336:12345-192.168.202.18@tcp:9:umount.0 Request processed in 323us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024138.209197:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 81 00000020:00010000:0.0:1789024138.209251:0:9520:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90cb0395f800: total 0 00010000:00010000:0.0:1789024138.209296:0:9520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cb0395f800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789024138.209347:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125c89d6/0xa736ef4b98cb4022 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af653 expref: 4 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024138.209382:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2a9e14/0xa736ef4b98cb46e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af82f expref: 3 pid: 10202 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024138.209411:0:9520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cb0395f800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789024138.209429:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024138.209431:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024138.209433:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024138.240578:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024138.243661:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402399360 00000100:00100000:1.0:1789024138.243678:0:7824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402399360 00000100:00100000:1.0:1789024138.243766:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 257 00000100:00100000:1.0:1789024138.243779:0:7824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+22:2399:x1875927402399360:12345-192.168.202.18@tcp:39:umount.0 00000020:00000080:1.0:1789024138.243815:0:7824:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3627 00000020:00010000:1.0:1789024138.243850:0:7824:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90cb02535800: total 0 00000100:00080000:1.0:1789024138.243855:0:7824:0:(import.c:65:import_set_state_nolock()) ffff90cb02533000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789024138.243901:0:7824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789024138.244094:0:7824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:382f7d83-ada1-4b7e-b952-8068d9fee082+21:2399:x1875927402399360:12345-192.168.202.18@tcp:39:umount.0 Request processed in 317us (3530us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789024138.244102:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 257 00000020:00010000:3.0:1789024138.244663:0:6503:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90cb02535800: total 0 00010000:00010000:3.0:1789024138.244721:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cb02535800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789024138.244757:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024138.244761:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789024138.244770:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb03a55000/0xa736ef4b98cb39ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af493 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244787:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024138.244790:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024138.244808:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb3fe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af63e expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244823:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024138.244825:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789024138.244829:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb400d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af64c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244841:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024138.244843:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789024138.244847:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc029c5200/0xa736ef4b98cb4099 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af66f expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244860:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024138.244863:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024138.244866:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ee00/0xa736ef4b98cb46a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af81a expref: 16 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244878:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc3bce2e00) 00010000:00010000:3.0:1789024138.244880:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024138.244884:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc15db1c00/0xa736ef4b98cb396f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af47e expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244901:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:3.0:1789024138.244904:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024138.244907:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb407d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af668 expref: 14 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244916:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024138.244924:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789024138.244929:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322000/0xa736ef4b98cb46ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af828 expref: 13 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244940:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90cb0231a100) 00010000:00010000:3.0:1789024138.244942:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024138.244946:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338ba00/0xa736ef4b98cb4386 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af748 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244958:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90cb0231b100) 00010000:00010000:3.0:1789024138.244960:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024138.244962:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4e00/0xa736ef4b98cb3cc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af56c expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244975:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cb0231bd00) 00010000:00010000:3.0:1789024138.244977:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024138.244980:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5000/0xa736ef4b98cb3953 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af477 expref: 10 pid: 7824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.244995:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90cc33aa9a00) 00010000:00010000:3.0:1789024138.244997:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024138.245000:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323000/0xa736ef4b98cb45c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af7e2 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.245018:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90cc33aa9700) 00010000:00010000:3.0:1789024138.245020:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024138.245023:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322e00/0xa736ef4b98cb3f03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af606 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024138.245049:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cb02535800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789024138.245065:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024138.245067:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024138.245069:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024138.260244:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024138.260337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402399488 00000100:00100000:0.0:1789024138.260347:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402399488 00000100:00100000:0.0:1789024138.260437:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 258 00000100:00100000:0.0:1789024138.260448:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+5:2399:x1875927402399488:12345-192.168.202.18@tcp:39:umount.0 00000100:00080000:2.0:1789024138.260464:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1789024138.261619:0:6515:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb362e 00000100:00080000:0.0:1789024138.261642:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90cb03352800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024138.261675:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1789024138.261815:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024138.261880:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:382f7d83-ada1-4b7e-b952-8068d9fee082+3:2399:x1875927402399488:12345-192.168.202.18@tcp:39:umount.0 Request processed in 1432us (1643us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789024138.261891:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 258 00000100:00100000:2.0:1789024138.642802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422363264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024138.642883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024138.643358:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363264 00000100:00100000:3.0:1789024138.643367:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363264 00000100:00100000:3.0:1789024138.643420:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789024138.643429:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422363264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024138.643462:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789024138.643530:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422363264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024138.643536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789024138.643664:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422363264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789024139.149192:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024139.660620:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789024139.660732:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422363392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024139.660833:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024139.660988:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422363520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024139.661019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024139.675967:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363392 00000100:00100000:3.0:1789024139.675995:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363392 00000100:00100000:3.0:1789024139.676289:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363520 00000100:00100000:3.0:1789024139.676298:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363520 00000100:00100000:0.0:1789024139.676409:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789024139.676432:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422363392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789024139.676488:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789024139.676601:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422363392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (15768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024139.676610:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789024139.677968:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422363392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789024139.688306:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024139.689930:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789024139.689948:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422363520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024139.689990:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789024139.690171:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422363520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (29122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024139.690184:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789024139.691125:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422363520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024140.138753:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024140.138926:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024140.145169:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402399744 00000100:00100000:1.0:1789024140.145191:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402399744 00000100:00100000:0.0:1789024140.145262:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024140.145400:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402399616 00000100:00100000:1.0:1789024140.145405:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402399616 00000100:00100000:1.0:1789024140.145424:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402399872 00000100:00100000:1.0:1789024140.145437:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402399872 00000100:00100000:1.0:1789024140.145473:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:1.0:1789024140.145485:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14ec32b5-f959-4605-b464-02aeac6020b2+12:2401:x1875927402399744:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024140.145513:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024140.145538:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb3731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3d6 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024140.145551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00010000:00010000:1.0:1789024140.145587:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024140.145604:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:1.0:1789024140.145615:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400128 00000100:00100000:1.0:1789024140.145619:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400128 00000100:00100000:0.0:1789024140.145625:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+11:2401:x1875927402399616:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024140.145637:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024140.145649:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb372a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af3a5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024140.145660:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024140.145672:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 259 00000100:00100000:1.0:1789024140.145681:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+6:2399:x1875927402400128:12345-192.168.202.18@tcp:39:umount.0 00000020:00000080:1.0:1789024140.145728:0:6516:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb373f 00000020:00010000:1.0:1789024140.145738:0:6516:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90cb0259a000: total 0 00000100:00100000:0.0:1789024140.145741:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+10:2401:x1875927402399616:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 115us (6812us total) trans 0 rc 0/0 00000100:00080000:1.0:1789024140.145746:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90cb0259f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789024140.145762:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000001:00000004:1.0:1789024140.145794:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789024140.145819:0:7924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:0.0:1789024140.145833:0:7924:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+9:2400:x1875927402399872:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024140.145848:0:7924:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024140.145867:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252f400/0xa736ef4b98cb3922 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af462 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024140.145883:0:7924:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024140.145921:0:7924:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a9a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:14ec32b5-f959-4605-b464-02aeac6020b2+8:2400:x1875927402399872:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 89us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.145932:0:7924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:1.0:1789024140.145970:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2399:x1875927402400128:12345-192.168.202.18@tcp:39:umount.0 Request processed in 289us (419us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789024140.145977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 259 00000100:00100000:1.0:1789024140.146398:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14ec32b5-f959-4605-b464-02aeac6020b2+7:2401:x1875927402399744:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 913us (7665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024140.146406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000020:00010000:1.0:1789024140.146584:0:9520:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90cb0259a000: total 0 00010000:00010000:1.0:1789024140.146642:0:9520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cb0259a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789024140.146675:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc11d52600) 00010000:00010000:1.0:1789024140.146679:0:9520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789024140.146687:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a800/0xa736ef4b98cb46f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af836 expref: 4 pid: 13818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024140.146713:0:9520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cb0259a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789024140.146724:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024140.146727:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024140.146729:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789024140.146864:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024140.156848:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024140.157195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400256 00000100:00100000:3.0:1789024140.157208:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400256 00000100:00100000:3.0:1789024140.157359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 260 00000100:00100000:3.0:1789024140.157378:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+5:2399:x1875927402400256:12345-192.168.202.18@tcp:39:umount.0 00000020:00000080:3.0:1789024140.157441:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3746 00000100:00080000:3.0:1789024140.157452:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cb02599800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789024140.157502:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789024140.157735:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1333f43e-b74a-4ef6-9a10-e9b68b18678f+3:2399:x1875927402400256:12345-192.168.202.18@tcp:39:umount.0 Request processed in 365us (897us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789024140.157742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 260 00010000:00010000:2.0:1789024140.158308:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789024140.159421:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024140.172946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422363648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024140.173099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024140.173273:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024140.173286:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024140.173325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789024140.173444:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024140.173679:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363648 00000100:00100000:3.0:1789024140.173693:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363648 00000100:00100000:3.0:1789024140.173808:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363776 00000100:00100000:3.0:1789024140.173814:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363776 00000100:00100000:3.0:1789024140.173849:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789024140.173866:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422363648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024140.173920:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024140.174021:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422363648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024140.174031:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789024140.174059:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024140.174071:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024140.174086:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024140.174124:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422363776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024140.174133:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024140.174243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422363776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024140.174267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422363648:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789024140.174394:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024140.176264:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422364160:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.176370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024140.176410:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422364032:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.176440:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422364672:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.176612:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024140.176645:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422365184:0@lo:400:kworker.0 00000100:00100000:2.0:1789024140.176656:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024140.176694:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364672 00000100:00100000:0.0:1789024140.176718:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364672 00000100:00100000:2.0:1789024140.176730:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422364544:0@lo:400:kworker.0 00000100:00100000:2.0:1789024140.176783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024140.176786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364032 00000100:00100000:0.0:1789024140.176792:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364032 00000100:00100000:2.0:1789024140.176827:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422365056:0@lo:400:kworker.0 00000100:00100000:2.0:1789024140.176863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024140.177279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422364288:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.177359:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422363904:0@lo:400:kworker.0 00000100:00100000:1.0:1789024140.177592:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364160 00000100:00100000:1.0:1789024140.177600:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364160 00000100:00100000:3.0:1789024140.177639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024140.177654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789024140.177667:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422364160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.177699:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422364416:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.178082:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024140.178114:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422364928:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.178142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024140.178216:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422363904 00000100:00100000:3.0:1789024140.178224:0:6508:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422363904 00000100:00100000:3.0:1789024140.178268:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789024140.178276:0:6508:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422363904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.178326:0:6508:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422363904:12345-0@lo:400:kworker.0 Request processed in 50us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024140.178334:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789024140.178406:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422363904:0@lo:400:kworker.0 00000100:00100000:1.0:1789024140.188881:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422364160:12345-0@lo:400:kworker.0 Request processed in 11203us (12497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024140.188899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789024140.188947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364416 00000100:00100000:1.0:1789024140.188958:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364416 00000100:00100000:1.0:1789024140.189006:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789024140.189015:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422364416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024140.189135:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422364416:12345-0@lo:400:kworker.0 Request processed in 122us (11053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024140.189142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789024140.189195:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364928 00000100:00100000:1.0:1789024140.189199:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364928 00000100:00100000:1.0:1789024140.189233:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789024140.189242:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422364928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024140.189276:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422364928:12345-0@lo:400:kworker.0 Request processed in 35us (11133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024140.189298:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789024140.189320:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024140.196732:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364544 00000100:00100000:0.0:1789024140.196749:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364544 00000100:00100000:0.0:1789024140.198010:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365056 00000100:00100000:0.0:1789024140.198089:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365056 00000100:00100000:0.0:1789024140.198127:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789024140.198137:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422364672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.198256:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422364672:12345-0@lo:400:kworker.0 Request processed in 119us (21644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.198263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789024140.198284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789024140.198290:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422364032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.198336:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422364032:12345-0@lo:400:kworker.0 Request processed in 47us (21687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.198342:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789024140.198354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789024140.198360:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422364544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.198388:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875927422364544:12345-0@lo:400:kworker.0 Request processed in 28us (21608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.198394:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789024140.198406:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789024140.198412:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422365056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.198439:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875927422365056:12345-0@lo:400:kworker.0 Request processed in 28us (21578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.198445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:0.0:1789024140.199025:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024140.199100:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024140.199129:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400512 00000100:00100000:0.0:1789024140.199135:0:6510:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400512 00000100:00100000:0.0:1789024140.199181:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 400 00000100:00100000:0.0:1789024140.199189:0:6510:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+7:2399:x1875927402400512:12345-192.168.202.18@tcp:251:umount.0 00000020:00000080:0.0:1789024140.199222:0:6510:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3604 00000020:00010000:0.0:1789024140.199233:0:6510:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90cc3543e000: total 0 00000100:00080000:0.0:1789024140.199239:0:6510:0:(import.c:65:import_set_state_nolock()) ffff90cc35438800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789024140.199287:0:6510:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc31288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14ec32b5-f959-4605-b464-02aeac6020b2+3:2399:x1875927402400512:12345-192.168.202.18@tcp:251:umount.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.199294:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 400 00000020:00010000:0.0:1789024140.199321:0:9521:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90cc3543e000: total 0 00010000:00010000:0.0:1789024140.199324:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024140.199374:0:9521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cc3543e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789024140.199408:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489800/0xa736ef4b98cb366d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af397 expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024140.199426:0:9521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cc3543e000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789024140.199437:0:9521:0:(genops.c:885:class_export_put()) final put ffff90cc3543e000/14ec32b5-f959-4605-b464-02aeac6020b2 00010000:00010000:0.0:1789024140.199449:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024140.199450:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024140.199452:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024140.200418:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422364416:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.200465:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422364928:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.200576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024140.200654:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422364800:0@lo:400:kworker.0 00000020:00000080:0.0:1789024140.200697:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3543e000/14ec32b5-f959-4605-b464-02aeac6020b2 for MGS 00000100:00100000:3.0:1789024140.200722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789024140.200753:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc35438800 for MGS 00000100:00100000:0.0:1789024140.200785:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364800 00000100:00100000:3.0:1789024140.200786:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024140.200797:0:8431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364800 00000100:00100000:3.0:1789024140.200835:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422364160:0@lo:400:kworker.0 00010000:00080000:3.0:1789024140.200870:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ed500 x1875927422364672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024140.200872:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789024140.200891:0:8431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422364800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.200950:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422364672:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.200971:0:8431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422364800:12345-0@lo:400:kworker.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.200979:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789024140.201007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422364288 00000100:00100000:3.0:1789024140.201018:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422364288 00000100:00100000:0.0:1789024140.201036:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422364800:0@lo:400:kworker.0 00000100:00100000:3.0:1789024140.201098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365184 00000100:00100000:3.0:1789024140.201105:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365184 00000100:00100000:0.0:1789024140.202074:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789024140.202086:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422364288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.202134:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422364288:12345-0@lo:400:kworker.0 Request processed in 53us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.202138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789024140.202162:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789024140.202167:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422365184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.202189:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422365184:12345-0@lo:400:kworker.0 Request processed in 24us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024140.202193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00080000:0.0:1789024140.202207:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024140.202226:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422364288:0@lo:400:kworker.0 00010000:00080000:0.0:1789024140.202249:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fab9180 x1875927422365184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024140.202257:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422365184:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.202397:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422364032:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.202410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875927422364544:0@lo:400:kworker.0 00000100:00100000:0.0:1789024140.202421:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875927422365056:0@lo:400:kworker.0 00010000:00010000:1.0:1789024141.197511:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024141.708565:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024141.708588:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422365312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024141.708668:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024141.708963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365312 00000100:00100000:0.0:1789024141.708972:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365312 00000100:00100000:0.0:1789024141.709027:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789024141.709037:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422365312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024141.709071:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789024141.709132:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422365312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024141.709139:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789024141.709220:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422365312:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024142.221527:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789024142.264862:0:15153:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789024142.288658:0:15153:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789024142.288717:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.288733:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.288741:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.288749:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.288770:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789024142.288776:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789024142.288806:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789024142.288810:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789024142.288816:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789024142.288836:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc3455d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789024142.289112:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024142.289120:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.289129:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01488c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024142.289134:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.289165:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024142.289174:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024142.289180:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789024142.289182:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789024142.289184:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789024142.289210:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.289217:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024142.289247:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.289254:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01488c00/0xa736ef4b98cb36ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36c1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.289266:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.289268:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.289270:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024142.289287:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422365440:0@lo:39:umount.0 00000100:00100000:0.0:1789024142.289349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024142.289425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365440 00000100:00100000:0.0:1789024142.289432:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365440 00000100:00100000:0.0:1789024142.289488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789024142.289496:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875927422365440:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789024142.289521:0:6517:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb321b 00000100:00080000:0.0:1789024142.289528:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90cc30c2e000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789024142.289581:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875927422365440:12345-0@lo:39:umount.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024142.289588:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:0.0:1789024142.289600:0:6517:0:(genops.c:885:class_export_put()) final put ffff90cc06590800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789024142.289621:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789024142.289630:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc06590800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789024142.289672:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc30c2e000 for lustre-MDT0000 00000100:00080000:0.0:1789024142.289702:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3455d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789024142.289710:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422365440:0@lo:39:umount.0 00000100:00100000:3.0:1789024142.289860:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422365568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.289892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789024142.289939:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789024142.289942:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789024142.289953:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789024142.290838:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290852:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290860:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290866:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290893:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024142.290899:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290905:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290912:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290918:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290928:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789024142.290935:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290942:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290958:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290964:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290974:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789024142.290980:0:15153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290987:0:15153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290992:0:15153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.290998:0:15153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.291008:0:15153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789024142.291011:0:15153:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789024142.291040:0:15153:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789024142.291044:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789024142.291048:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789024142.291052:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789024142.291057:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90cc35448000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789024142.291063:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90cb01a1e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789024142.291067:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90cc41598800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789024142.291076:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90cc3538e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789024142.291083:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90cb0259a000 1333f43e-b74a-4ef6-9a10-e9b68b18678f 192.168.202.18@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789024142.291088:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90cb02535800 382f7d83-ada1-4b7e-b952-8068d9fee082 192.168.202.18@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1789024142.291093:0:15153:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff90cc30c319c0) has exports, disconnecting them 00000020:00080000:3.0:1789024142.291096:0:15153:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cc35448000), last request at 1789024140 00000020:00000080:3.0:1789024142.291102:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb352b 00000100:00080000:3.0:1789024142.291118:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc3544a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789024142.291181:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc35448000): rc 0 00000020:00000080:3.0:1789024142.291183:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc35448000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789024142.291191:0:15153:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cb01a1e800), last request at 1789024140 00000020:00000080:3.0:1789024142.291193:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3405 00000100:00080000:3.0:1789024142.291198:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cb01a1a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789024142.291204:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cb01a1e800): rc 0 00000020:00000080:3.0:1789024142.291206:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cb01a1e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789024142.291210:0:15153:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cc41598800), last request at 1789023906 00000020:00000080:3.0:1789024142.291213:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3302 00000100:00080000:3.0:1789024142.291217:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc4159d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789024142.291221:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc41598800): rc 0 00000020:00000080:3.0:1789024142.291223:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc41598800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789024142.291233:0:15153:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90cc3538e800), last request at 1789023906 00000020:00000080:3.0:1789024142.291237:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32d1 00000100:00080000:3.0:1789024142.291240:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc3538f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789024142.291245:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1789024142.291323:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3538e800): rc 0 00000004:00000080:3.0:1789024142.291329:0:15153:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9dfe01c63ae0 00000100:00080000:3.0:1789024142.291345:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789024142.291354:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1789024142.292180:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789024142.292207:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc2c328000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789024142.292262:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789024142.292269:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292278:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024142.292282:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292293:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024142.292300:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024142.292306:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024142.292309:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789024142.292311:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789024142.292338:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292344:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024142.292358:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292364:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a161e00/0xa736ef4b98cb36c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36cf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292384:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789024142.292403:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292409:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024142.292412:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292418:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024142.292423:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024142.292428:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024142.292430:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789024142.292432:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789024142.292458:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292463:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024142.292478:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292484:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1600/0xa736ef4b98cb35be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb35c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292491:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789024142.292495:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292500:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a54400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024142.292509:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292516:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024142.292522:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024142.292528:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789024142.292530:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789024142.292532:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789024142.292552:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292558:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024142.292565:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292571:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a54400/0xa736ef4b98cb3914 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb391b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292580:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024142.292584:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292589:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024142.292591:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292598:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024142.292610:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024142.292615:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024142.292617:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789024142.292618:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789024142.292631:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292636:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024142.292642:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292648:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00031000/0xa736ef4b98cb317a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb3181 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.292658:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024142.292660:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024142.292661:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024142.292680:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422366208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.292746:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024142.292786:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024142.292792:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422365824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.292814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024142.292849:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422366080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.292871:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024142.292888:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024142.292893:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422365952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.292920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024142.292947:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365568 00000100:00100000:3.0:1789024142.292954:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365568 00000100:00100000:3.0:1789024142.292997:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366208 00000100:00100000:3.0:1789024142.293000:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366208 00000100:00100000:3.0:1789024142.293011:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365824 00000100:00100000:3.0:1789024142.293013:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365824 00000100:00100000:3.0:1789024142.293022:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366080 00000100:00100000:3.0:1789024142.293024:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366080 00000100:00100000:3.0:1789024142.293034:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365952 00000100:00100000:3.0:1789024142.293036:0:6500:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365952 00000100:00100000:3.0:1789024142.293052:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789024142.293060:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+28:3641:x1875927422365568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024142.293073:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024142.293087:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00031200/0xa736ef4b98cb36c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb36ba expref: 28 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.293100:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024142.293134:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+27:3641:x1875927422365568:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024142.293141:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789024142.293184:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789024142.293190:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+26:3641:x1875927422366208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024142.293197:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024142.293206:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160200/0xa736ef4b98cb3181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb317a expref: 26 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.293215:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024142.293235:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+25:3641:x1875927422366208:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024142.293247:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789024142.293260:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789024142.293265:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+24:3641:x1875927422365824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024142.293272:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024142.293280:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0800/0xa736ef4b98cb36cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb36c8 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.293288:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024142.293311:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+23:3641:x1875927422365824:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024142.293316:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789024142.293327:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789024142.293332:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+22:3644:x1875927422366080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024142.293338:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024142.293345:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb03a54a00/0xa736ef4b98cb391b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3914 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.293353:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024142.293375:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+21:3644:x1875927422366080:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024142.293381:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789024142.293393:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789024142.293399:0:6500:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+20:3644:x1875927422365952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024142.293405:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024142.293413:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb35c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb35be expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024142.293432:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789024142.293822:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789024142.293913:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc35448000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789024142.293960:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb01a1e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789024142.293985:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc41598800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789024142.294008:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3544a000 for lustre-MDT0000 00000020:00000080:0.0:1789024142.294012:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb01a1a800 for lustre-MDT0000 00000020:00000080:0.0:1789024142.294015:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc4159d000 for lustre-MDT0000 00010000:00010000:0.0:1789024142.294025:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.294033:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024142.294045:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422365696:0@lo:39:umount.0 00000100:00100000:0.0:1789024142.294084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024142.294121:0:7823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422365696 00000100:00100000:0.0:1789024142.294128:0:7823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422365696 00000100:00100000:0.0:1789024142.294179:0:7823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789024142.294187:0:7823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875927422365696:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789024142.294211:0:7823:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb335d 00000100:00080000:0.0:1789024142.294220:0:7823:0:(import.c:65:import_set_state_nolock()) ffff90cc35387800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024142.294240:0:7823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789024142.294354:0:7823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3640:x1875927422365696:12345-0@lo:39:umount.0 Request processed in 168us (269us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789024142.294361:0:7823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1789024142.294416:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc2c328000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789024142.294423:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422365696:0@lo:39:umount.0 00010000:00010000:0.0:1789024142.294444:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789024142.294593:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789024142.294597:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789024142.294615:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789024142.294678:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789024142.294700:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789024142.294711:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789024142.294714:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789024142.294720:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789024142.294771:0:15153:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789024142.294779:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cb01a01800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789024142.294805:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90cc30c319c0) has no exports 00000100:00100000:2.0:1789024142.295228:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422365824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024142.295238:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422366208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024142.295246:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2a60d918-c836-4e5c-bd08-febd347ea726:3641:1875927422365568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024142.298279:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422366336:0@lo:9:umount.0 00000100:00100000:0.0:1789024142.298358:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024142.298414:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422366464:0@lo:9:umount.0 00000100:00100000:0.0:1789024142.298445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024142.298511:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366336 00000100:00100000:0.0:1789024142.298519:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366336 00000100:00100000:0.0:1789024142.298567:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366464 00000100:00100000:0.0:1789024142.298570:0:8433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366464 00000100:00100000:0.0:1789024142.298590:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789024142.298598:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875927422366336:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789024142.298624:0:8433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb34bb 00000100:00080000:0.0:1789024142.298634:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024142.298676:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789024142.298819:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875927422366336:12345-0@lo:9:umount.0 Request processed in 222us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024142.298827:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789024142.298844:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789024142.298850:0:8433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875927422366464:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789024142.298860:0:8433:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb35fd 00000100:00080000:0.0:1789024142.298866:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90cb033f2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024142.298887:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789024142.298951:0:8433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3640:x1875927422366464:12345-0@lo:9:umount.0 Request processed in 101us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024142.298958:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789024142.298974:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789024142.298978:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789024142.298993:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.298999:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789024142.299029:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789024142.299040:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789024142.299043:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789024142.299046:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422366336:0@lo:9:umount.0 00000100:00080000:0.0:1789024142.299056:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb01a01800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789024142.299070:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789024142.299072:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789024142.299074:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc08782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422366464:0@lo:9:umount.0 00000100:00100000:3.0:1789024142.305700:0:6500:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a60d918-c836-4e5c-bd08-febd347ea726+19:3644:x1875927422365952:12345-0@lo:103:ldlm_bl.0 Request processed in 12291us (12769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024142.305714:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789024142.305779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422365952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024142.305804:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422366080:0@lo:103:ldlm_bl.0 00000001:00100000:0.0:1789024142.311691:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024142.311701:0:6494:0:(genops.c:885:class_export_put()) final put ffff90cc3538e800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789024142.311772:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00080000:0.0:1789024142.311780:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789024142.311791:0:6494:0:(genops.c:885:class_export_put()) final put ffff90cb0259a000/1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000020:00000080:1.0:1789024142.314729:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789024142.315562:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3538f800 for lustre-MDT0000 00000001:00100000:0.0:1789024142.316589:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000001:00080000:0.0:1789024142.316600:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789024142.316610:0:6494:0:(genops.c:885:class_export_put()) final put ffff90cb02535800/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:1.0:1789024142.320293:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0259a000/1333f43e-b74a-4ef6-9a10-e9b68b18678f for lustre-MDT0000 00000020:00000080:1.0:1789024142.320374:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb0259f800 for lustre-MDT0000 00000020:00000080:2.0:1789024142.320628:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb02535800/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-MDT0000 00000020:00000080:2.0:1789024142.320673:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb02533000 for lustre-MDT0000 00000020:00080000:3.0:1789024142.325282:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90cc30c319c0) has no exports 00000020:00000080:3.0:1789024142.380506:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb31d5 00000020:00000080:3.0:1789024142.380524:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc34512800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789024142.380589:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789024142.380718:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024142.380730:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789024142.380734:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff90cc344e8000) has no exports 00000020:00000080:2.0:1789024142.381071:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb31ce 00000020:00000080:2.0:1789024142.381077:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc344f1000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789024142.381740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc34512800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789024142.381898:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024142.381909:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789024142.381913:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc2d08d000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789024142.381915:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc2d08d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789024142.381936:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789024142.382176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc344f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789024142.382280:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc35419d20 - data ffff90cc0f62d948/ffff90cb03325c00 00000020:01000000:2.0:1789024142.382403:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc105e0d20 - data ffff90cc0f550000/ffff90cc15aae000 00000001:00000004:2.0:1789024142.402452:0:15153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789024142.455238:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789024142.455248:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789024142.455263:0:15153:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90cc3be9d180 x1875927422365696/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789024152 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024142.455288:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789024142.464120:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789024142.464128:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789024142.464162:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024142.464165:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789024142.464564:0:8901:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789024142.464569:0:8901:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789024142.464578:0:8901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789024142.465203:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789024142.465207:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789024142.465214:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024142.465216:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789024142.465544:0:9985:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789024142.465548:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789024142.465557:0:9985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789024142.466557:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb319d 00000020:00000080:2.0:1789024142.466569:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc30c2c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789024142.468456:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb31b2 00000020:00000080:2.0:1789024142.468468:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc30c2a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789024142.468477:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789024142.468482:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024142.468490:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789024142.468493:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff90cc3399cd40) has no exports 00000004:01000000:2.0:1789024142.468653:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789024142.468663:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb35e8 00000020:00000080:2.0:1789024142.468668:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cb03355000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789024142.468672:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789024142.468676:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024142.468691:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789024142.468694:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff90cc344eb380) has no exports 00000020:00000080:2.0:1789024142.468700:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb35e1 00000020:00000080:2.0:1789024142.468705:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cb01a1e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789024142.468993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c2c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789024142.469003:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c2a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789024142.469007:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb03355000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789024142.469011:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb01a1e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789024142.469548:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789024142.469554:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789024142.469558:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789024142.469564:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024142.469566:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789024142.469644:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024142.469655:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789024142.469661:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb34a6 00000020:00000080:2.0:1789024142.469667:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc3d4b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789024142.472284:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb01a01800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789024142.472304:0:37:0:(genops.c:885:class_export_put()) final put ffff90cb0259c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789024142.472307:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0259c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789024142.472315:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789024142.472441:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789024142.472488:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024142.472504:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789024142.472510:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff90cc415a0000) has no exports 00000020:00000080:2.0:1789024142.472519:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb349f 00000020:00000080:2.0:1789024142.472525:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc3d4b1000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789024142.472987:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789024142.472992:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789024142.472996:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1789024142.473003:0:15153:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024142.473005:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789024142.473053:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024142.473061:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789024142.473075:0:15153:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789024142.473268:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3356 00000020:00000080:2.0:1789024142.473274:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc3bd90000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789024142.473281:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789024142.473293:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024142.473297:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789024142.473310:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff90cc31214d40) has no exports 00000020:00000080:2.0:1789024142.473315:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb334f 00000020:00000080:2.0:1789024142.473318:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc2c32b800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789024142.474506:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789024142.474513:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789024142.474517:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789024142.474533:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789024142.474573:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024142.474581:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789024142.474609:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024142.474613:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789024142.474616:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc06597800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789024142.474620:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc06597800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789024142.474626:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789024142.474723:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb31b9 00000020:00000080:0.0:1789024142.474730:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc30c2e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789024142.474734:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789024142.474737:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024142.474741:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789024142.474744:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff90cc30c34d40) has no exports 00000020:00000080:0.0:1789024142.474763:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024142.474766:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789024142.474770:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb31c0 00000020:00000080:0.0:1789024142.474773:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc30c29800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789024142.474781:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc199e6000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789024142.474798:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc199e6000 3 00000020:01000004:0.0:1789024142.474802:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cc199e6000 from lustre-MDT0000 00000020:00000080:0.0:1789024142.474820:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024142.474824:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789024142.474826:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc30c2b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789024142.474829:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c2b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789024142.474837:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789024142.474868:0:15153:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789024142.474871:0:15153:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789024142.474874:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789024142.474876:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024142.474879:0:15153:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789024142.474884:0:15153:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff90cc315f2800 2a60d918-c836-4e5c-bd08-febd347ea726 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789024142.474895:0:15153:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff90cc33998000) has exports, disconnecting them 00000020:00080000:0.0:1789024142.474899:0:15153:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90cc315f2800), last request at 1789023887 00000020:00000080:0.0:1789024142.474913:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb315e 00000020:00010000:0.0:1789024142.474918:0:15153:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90cc315f2800: total 6 00000100:00080000:0.0:1789024142.474922:0:15153:0:(import.c:65:import_set_state_nolock()) ffff90cc315f5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789024142.474933:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc315f2800): rc 0 00000020:00080000:0.0:1789024142.474937:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff90cc33998000) has no exports 00000020:00010000:0.0:1789024142.474947:0:6504:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90cc315f2800: total 6 00010000:00010000:0.0:1789024142.474973:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90cc315f2800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789024142.474999:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01489e00/0xa736ef4b98cb38ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb38f8 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475016:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a161800/0xa736ef4b98cb36a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb369e expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475026:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb325a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3253 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475039:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0200/0xa736ef4b98cb36b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb36ac expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475048:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c4400/0xa736ef4b98cb3268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3261 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475060:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1e00/0xa736ef4b98cb38f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb38ea expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475070:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db1200/0xa736ef4b98cb390d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3906 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475481:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb367b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3674 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475504:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc15db0600/0xa736ef4b98cb36dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb36d6 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475514:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5c00/0xa736ef4b98cb357f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3578 expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475527:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a160a00/0xa736ef4b98cb3666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb365f expref: 4 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475537:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb3689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3682 expref: 3 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475547:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030c00/0xa736ef4b98cb3697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa736ef4b98cb3690 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024142.475557:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90cc315f2800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789024142.475573:0:6504:0:(genops.c:885:class_export_put()) final put ffff90cc315f2800/2a60d918-c836-4e5c-bd08-febd347ea726 00010000:00010000:0.0:1789024142.475581:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.475583:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024142.475586:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024142.475652:0:6510:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff90cc15c8ba00:6510] 2 exiting: rc = 0 00000100:00100000:0.0:1789024142.475757:0:6508:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff90cc19219800:6508] 0 exiting: rc = 1 00000100:00100000:3.0:1789024142.475927:0:6509:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff90cc06782000:6509] 1 exiting: rc = 0 00000100:00100000:0.0:1789024142.475998:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476006:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476012:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476018:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476024:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476030:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476037:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476043:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476058:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476064:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476069:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476075:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476098:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476106:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476112:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476117:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476124:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476130:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476136:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476141:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476168:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476176:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476181:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476187:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476194:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476199:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476206:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476212:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476217:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476222:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476227:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476232:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476237:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476242:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476247:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476251:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476256:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476260:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476266:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476271:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476275:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476280:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476284:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476298:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476304:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476309:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476314:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476318:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476323:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476328:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476333:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476337:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476342:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476347:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476353:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476358:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476364:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476369:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476373:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476378:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476383:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476388:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476393:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024142.476398:0:15153:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789024142.477236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3d4b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789024142.477245:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3d4b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789024142.477250:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3d4b0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789024142.477256:0:37:0:(genops.c:885:class_export_put()) final put ffff90cc3538b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789024142.477259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789024142.477262:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789024142.477289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bd90000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789024142.477294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc2c32b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789024142.477297:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc2c328000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789024142.477301:0:37:0:(genops.c:885:class_export_put()) final put ffff90cc3538b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789024142.477303:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789024142.477305:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789024142.477332:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c2e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789024142.477335:0:37:0:(genops.c:885:class_export_put()) final put ffff90cc30c2d800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789024142.477345:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c2d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789024142.477349:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789024142.477375:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc30c29800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789024142.477379:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc315f2800/2a60d918-c836-4e5c-bd08-febd347ea726 for MGS 00000020:00000080:1.0:1789024142.477399:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc315f5000 for MGS 00000020:01000000:1.0:1789024142.483538:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cb022c6780 - data ffff90cc0f716e58/ffff90cc3f953400 00000020:01000000:1.0:1789024142.483674:0:15153:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc310a3420 - data ffff90cc0f473bd0/ffff90cc15c6c400 00000020:00000080:1.0:1789024142.486058:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3142 00000020:00000080:1.0:1789024142.486071:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc199e6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789024142.486335:0:15153:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc199e6000 from MGS, refs=2 00000020:01000004:1.0:1789024142.486339:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc199e6000 2 00000020:01000004:1.0:1789024142.486342:0:15153:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cc199e6000 from MGS 00000020:00000080:1.0:1789024142.486367:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024142.486374:0:15153:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789024142.486378:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc199e5000/MGS 00000020:00000080:1.0:1789024142.486381:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc199e5000/MGS for MGS 00000020:01000000:1.0:1789024142.486387:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789024142.486458:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789024142.486463:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024142.486469:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789024142.486475:0:15153:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90cc34558000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789024142.486480:0:15153:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff90cc344e99c0) has exports, disconnecting them 00000020:00080000:1.0:1789024142.486485:0:15153:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90cc34558000), last request at 1789023887 00000020:00000080:1.0:1789024142.486489:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb320d 00000020:00080000:1.0:1789024142.486499:0:15153:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc34558000): rc 0 00000020:00000080:1.0:1789024142.486503:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc34558000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789024142.486633:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc199e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789024142.491546:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc34558000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789024142.492990:0:15153:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789024142.492997:0:15153:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789024142.493002:0:15153:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789024142.493010:0:15153:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789024142.493043:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3455d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789024142.493225:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024142.493235:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789024142.493241:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc344f5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789024142.493245:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc344f5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789024142.493250:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789024142.493347:0:15153:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc199e6000 1 00000020:00000080:0.0:1789024142.493353:0:15153:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3134 00000020:00000080:0.0:1789024142.493360:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc199e5800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789024142.493369:0:15153:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789024142.493377:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc199e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789024142.493386:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024142.493390:0:15153:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789024142.493394:0:15153:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff90cc3399b380) has no exports 00000020:00000080:1.0:1789024142.635351:0:15153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024142.635364:0:15153:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789024142.635371:0:15153:0:(genops.c:885:class_export_put()) final put ffff90cc199e2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789024142.635375:0:15153:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc199e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789024142.635395:0:15153:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789024142.635516:0:15153:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90cc199e1800 00000020:02000400:1.0:1789024142.635567:0:15153:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789024143.252560:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789024143.773692:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789024143.773705:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789024143.773709:0:7445:0:(genops.c:885:class_export_put()) final put ffff90cc3bd3d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789024143.773727:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00080000:3.0:1789024143.773732:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789024143.773734:0:7445:0:(genops.c:885:class_export_put()) final put ffff90cb02598000/1333f43e-b74a-4ef6-9a10-e9b68b18678f 00000001:00100000:3.0:1789024143.773748:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000001:00080000:3.0:1789024143.773753:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789024143.773755:0:7445:0:(genops.c:885:class_export_put()) final put ffff90cb03353000/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:1.0:1789024143.773803:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bd3d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789024143.773863:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb02598000/1333f43e-b74a-4ef6-9a10-e9b68b18678f for lustre-MDT0001 00000020:00000080:1.0:1789024143.773884:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb03353000/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-MDT0001 00000020:00000080:1.0:1789024143.773909:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc35387800 for lustre-MDT0001 00000020:00000080:1.0:1789024143.773914:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb02599800 for lustre-MDT0001 00000020:00000080:1.0:1789024143.773917:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb03352800 for lustre-MDT0001 00000001:00100000:1.0:1789024143.774931:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789024143.775134:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cc3d4b2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789024143.775190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3d4b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789024143.775224:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3d4b5000 for lustre-OST0000 00000001:00100000:1.0:1789024143.775479:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:1.0:1789024143.775482:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cb0395f800/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:3.0:1789024143.775889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0395f800/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-OST0000 00000020:00000080:3.0:1789024143.775987:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc1b297800 for lustre-OST0000 00000001:00100000:1.0:1789024143.777668:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789024143.777676:0:9511:0:(genops.c:885:class_export_put()) final put ffff90cb033f5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789024143.777714:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:1.0:1789024143.777717:0:9511:0:(genops.c:885:class_export_put()) final put ffff90cc3544c000/382f7d83-ada1-4b7e-b952-8068d9fee082 00000020:00000080:0.0:1789024143.777862:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb033f5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789024143.777933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3544c000/382f7d83-ada1-4b7e-b952-8068d9fee082 for lustre-OST0001 00000020:00000080:0.0:1789024143.778600:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb033f2800 for lustre-OST0001 00000020:00000080:0.0:1789024143.778614:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3544f800 for lustre-OST0001 00010000:00010000:0.0:1789024144.271865:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024144.786912:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422366592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024144.786993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024144.787185:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366592 00000100:00100000:3.0:1789024144.787193:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366592 00000100:00100000:3.0:1789024144.787249:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789024144.787258:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422366592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024144.787298:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789024144.787345:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422366592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024144.787353:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789024144.787397:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422366592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789024144.787533:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789024145.292395:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024145.292516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024145.292549:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422366720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024145.292615:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024145.292897:0:11084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366720 00000100:00100000:3.0:1789024145.292906:0:11084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366720 00000100:00100000:3.0:1789024145.292977:0:11084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789024145.292987:0:11084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422366720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024145.293017:0:11084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789024145.293080:0:11084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422366720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024145.293089:0:11084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789024145.293122:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422366720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789024145.293241:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422366848:0@lo:400:kworker.0 00000400:00000100:2.0:1789024145.293273:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927422366848 offset 0 length 224: 4 00000100:00100000:2.0:1789024145.293298:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422367360:0@lo:400:kworker.0 00000100:00100000:2.0:1789024145.293322:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789024145.293328:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024145.293345:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422366976:0@lo:400:kworker.0 00000100:00100000:2.0:1789024145.293354:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789024145.293362:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422367232:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.293387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024145.293393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024145.293421:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422367744:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.293436:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422367488:0@lo:400:kworker.0 00000100:00100000:2.0:1789024145.293449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024145.293470:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024145.293499:0:8904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367488 00000100:00100000:1.0:1789024145.293499:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789024145.293504:0:8904:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367488 00000100:00100000:1.0:1789024145.293509:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422367104:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.293545:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024145.293564:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422367616:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.293601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024145.293630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422366976 00000100:00100000:1.0:1789024145.293634:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422366976 00000100:00100000:1.0:1789024145.293660:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789024145.293667:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875927422366976:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789024145.293675:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789024145.293685:0:8904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789024145.293695:0:8904:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422367488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.293712:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875927422366976:12345-0@lo:400:kworker.0 Request processed in 43us (325us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789024145.293720:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789024145.293736:0:8904:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422367488:12345-0@lo:400:kworker.0 Request processed in 43us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024145.293742:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367360 00000100:00100000:2.0:1789024145.293743:0:8904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789024145.293748:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367360 00000100:00100000:1.0:1789024145.293780:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367232 00000100:00100000:1.0:1789024145.293783:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367232 00000100:00100000:1.0:1789024145.293801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367744 00000100:00100000:1.0:1789024145.293804:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367744 00000100:00100000:0.0:1789024145.293812:0:13818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367104 00000100:00100000:0.0:1789024145.293818:0:13818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367104 00000100:00100000:1.0:1789024145.293823:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367616 00000100:00100000:1.0:1789024145.293828:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367616 00000100:00100000:0.0:1789024145.293840:0:13818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789024145.293849:0:13818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422367360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024145.293893:0:13818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422367360:12345-0@lo:400:kworker.0 Request processed in 46us (570us total) trans 0 rc 0/0 00010000:00080000:2.0:1789024145.293954:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90cb03bef100 x1875927422367360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024145.293965:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422367360:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.294036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789024145.294045:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422367744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.294089:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875927422367744:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024145.294095:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789024145.294108:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789024145.294111:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875927422367232:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789024145.294116:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789024145.294136:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc08781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875927422367232:12345-0@lo:400:kworker.0 Request processed in 23us (746us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789024145.294142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789024145.294194:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789024145.294198:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875927422367104:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789024145.294204:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789024145.294227:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875927422367104:12345-0@lo:400:kworker.0 Request processed in 27us (682us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789024145.294232:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789024145.294246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789024145.294249:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875927422367616:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789024145.294253:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789024145.294273:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875927422367616:12345-0@lo:400:kworker.0 Request processed in 22us (671us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789024145.294277:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1789024145.294309:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024145.294328:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789024145.294334:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc3538a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789024145.294337:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789024145.295823:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789024145.295829:0:3644:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789024145.295833:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789024145.295838:0:3644:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789024145.295841:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 245 00000100:00080000:2.0:1789024145.295852:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90cc3543f800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024145.295882:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3be9e300 x1875927422367872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024145.295907:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422367232:0@lo:400:kworker.0 00010000:00080000:2.0:1789024145.295922:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90cc3fae0e00 x1875927422367744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024145.295945:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422367744:0@lo:400:kworker.0 00000100:00100000:2.0:1789024145.295974:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422367872:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1789024145.296014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024145.301650:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422367872 00000100:00100000:3.0:1789024145.301666:0:6516:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422367872 00000100:00100000:3.0:1789024145.301834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789024145.301843:0:6516:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422367872:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1789024145.301869:0:6516:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789024145.302064:0:6516:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422367872:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 220us (6048us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789024145.302072:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789024145.302114:0:13818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:2.0:1789024145.302267:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789024145.302273:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789024145.302277:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422367872:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789024145.311177:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc3538a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024145.311190:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 224 00000100:00080000:1.0:1789024145.311206:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cc3538a000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024145.311241:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab8e00 x1875927422368000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789024145.311270:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422367104:0@lo:400:kworker.0 00000100:00080000:1.0:1789024145.311299:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789024145.311303:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789024145.311307:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789024145.311317:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024145.311320:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 265 00000100:00080000:1.0:1789024145.311326:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90cc3bf9b000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024145.311340:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab9c00 x1875927422368128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789024145.311351:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422367616:0@lo:400:kworker.0 00000100:00080000:1.0:1789024145.311366:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789024145.311369:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc346db800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1789024145.311969:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422368000:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789024145.312033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024145.312067:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422368128:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789024145.312085:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024145.312124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368000 00000100:00100000:2.0:1789024145.312135:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368000 00000100:00100000:2.0:1789024145.312180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368128 00000100:00100000:2.0:1789024145.312183:0:6517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368128 00000100:00100000:2.0:1789024145.312199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789024145.312206:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422368000:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789024145.312225:0:6517:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789024145.312263:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422368000:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (230us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789024145.312270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789024145.312285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789024145.312288:0:6517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422368128:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789024145.312297:0:6517:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789024145.312320:0:6517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422368128:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (233us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789024145.312326:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789024145.312352:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789024145.312356:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789024145.312360:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422368000:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1789024145.312367:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789024145.312370:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789024145.312372:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422368128:0@lo:38:ptlrpcd_00_00.0 00000100:02000400:1.0:1789024145.313002:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789024145.313010:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90cc346db800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024145.313014:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 224 00000100:00080000:1.0:1789024145.313022:0:3641:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cc346db800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024145.313053:0:3641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab8700 x1875927422368256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024145.313619:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422368256:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789024145.313660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024145.313730:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422366976:0@lo:400:kworker.0 00000100:00100000:1.0:1789024145.313752:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422367488:0@lo:400:kworker.0 00000100:00100000:3.0:1789024145.313879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368256 00000100:00100000:3.0:1789024145.313885:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368256 00000100:00100000:3.0:1789024145.313917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789024145.313923:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422368256:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1789024145.313945:0:6521:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789024145.314497:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422368256:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 571us (835us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789024145.314504:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:2.0:1789024145.314610:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc346db800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789024145.314616:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789024145.314625:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422368256:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789024146.316335:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789024146.462688:0:15354:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789024146.479445:0:15354:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789024146.479498:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.479513:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.479521:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.479527:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.479552:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789024146.479557:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789024146.479580:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024146.479584:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789024146.479590:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789024146.479595:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cc3538a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789024146.479599:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024146.479601:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789024146.479604:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789024146.480277:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024146.480285:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024146.480293:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024146.480297:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024146.480389:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024146.480404:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024146.480411:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789024146.480414:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789024146.480416:0:9520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789024146.480452:0:9520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024146.480459:0:9520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024146.480489:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024146.480496:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc00030e00/0xa736ef4b98cb369e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024146.480508:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024146.480510:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024146.480512:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024146.480564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422368384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024146.480629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024146.480782:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368384 00000100:00100000:1.0:1789024146.480790:0:6502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368384 00000100:00100000:1.0:1789024146.480835:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789024146.480841:0:6502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875927422368384:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789024146.480847:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789024146 with bad export cookie 12049080961041379678 00010000:00010000:2.0:1789024146.483218:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.483237:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.483261:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.483268:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.483289:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024146.483295:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.483302:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483416:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024146.483424:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483431:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024146.483434:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483443:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024146.483449:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024146.483456:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024146.483458:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789024146.483487:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483493:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024146.483516:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483534:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a161600/0xa736ef4b98cb36ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb36b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.483546:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024146.483548:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024146.483550:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024146.483559:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024146.483574:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422368512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024146.483635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024146.483676:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368512 00000100:00100000:3.0:1789024146.483683:0:6501:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368512 00000100:00100000:3.0:1789024146.483712:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789024146.483718:0:6501:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc33a99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875927422368512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789024146.483724:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789024146 with bad export cookie 12049080961041379678 00000100:00100000:3.0:1789024146.484700:0:6501:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc33a99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1875927422368512:12345-0@lo:103:ldlm_bl.0 Request processed in 978us (1062us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789024146.484712:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1789024146.485008:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.485016:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.485099:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024146.485109:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.485116:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.485122:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.485143:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789024146.485199:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.118@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789024146.485205:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789024146.485209:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.118@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789024146.486159:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024146.486169:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.486185:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024146.486189:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.486198:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024146.486204:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024146.486210:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789024146.486212:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789024146.486215:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789024146.486383:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024146.486393:0:15354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.486411:0:15354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.486416:0:15354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.486422:0:15354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.486437:0:15354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789024146.486440:0:15354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789024146.486443:0:15354:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789024146.486482:0:15354:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789024146.486486:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789024146.486491:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024146.486496:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789024146.486501:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90cc3d4b2000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789024146.486506:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90cb021f9800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789024146.486511:0:15354:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff90cc415a19c0) has exports, disconnecting them 00000020:00080000:2.0:1789024146.486515:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90cc3d4b2000), last request at 1789024145 00000020:00000080:2.0:1789024146.486522:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3540 00000100:00080000:2.0:1789024146.486546:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789024146.486600:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3d4b2000): rc 0 00000020:00000080:2.0:1789024146.486602:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc3d4b2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789024146.486612:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90cb021f9800), last request at 1789024145 00000020:00000080:2.0:1789024146.486615:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb341a 00000100:00080000:2.0:1789024146.486620:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cb021fe800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789024146.486626:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cb021f9800): rc 0 00000020:00000080:2.0:1789024146.486628:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cb021f9800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789024146.486635:0:15354:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9dfe00d7fae0 00000100:00080000:2.0:1789024146.486653:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024146.486656:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1789024146.487570:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789024146.487576:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cc346db800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789024146.488219:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789024146.488227:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.488237:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fc00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024146.488240:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024146.488249:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024146.488256:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024146.488260:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789024146.488263:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789024146.488266:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:3.0:1789024146.503277:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.118@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789024146.503285:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789024146.503298:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cb03bef800 x1875927422366848/t0(0) o400->MGC192.168.202.118@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789024161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024146.503322:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3fab9f80 x1875927422368384/t0(0) o103->MGC192.168.202.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789024162 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024146.503356:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ed500 x1875927422368512/t0(0) o103->MGC192.168.202.118@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789024162 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789024146.503470:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789024146.503474:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789024146.503475:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1789024146.504033:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024146.504043:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.504053:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024146.504057:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.504066:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024146.504073:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024146.504079:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789024146.504082:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789024146.504092:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789024146.504108:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:0.0:1789024146.504112:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.504119:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5800/0xa736ef4b98cb3261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3268 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.504138:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024146.504139:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024146.504141:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789024146.504220:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024146.504227:0:3642:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 205 00000100:00080000:3.0:1789024146.504239:0:3642:0:(import.c:666:import_select_connection()) MGC192.168.202.118@tcp: import ffff90cc18a7e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024146.504263:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422368384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024146.504271:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2a60d918-c836-4e5c-bd08-febd347ea726:3644:1875927422366848:0@lo:400:kworker.0 00000100:00080000:2.0:1789024146.504283:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789024146.504287:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1789024146.504300:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1789024146.504301:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3d4b2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789024146.504344:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb021f9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:2.0:1789024146.504356:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:3.0:1789024146.504364:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3d4b1800 for lustre-MDT0001 00000020:00000080:3.0:1789024146.504368:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb021fe800 for lustre-MDT0001 00000100:00080000:2.0:1789024146.504370:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cc34513000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789024146.504384:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789024146.504387:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1789024146.504408:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789024146.504471:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9eca80 x1875927422368768/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024146.504476:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422368640:0@lo:9:umount.0 00000100:00100000:3.0:1789024146.504496:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:3642:1875927422368512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024146.504530:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024146.504534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024146.504537:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789024146.504549:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024146.504555:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0252fc00/0xa736ef4b98cb3906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb390d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024146.504564:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422368768:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:3.0:1789024146.504574:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024146.504576:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024146.504578:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1789024146.504580:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927422368768 offset 0 length 520: 4 00000100:00100000:3.0:1789024146.504585:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2a60d918-c836-4e5c-bd08-febd347ea726:0:1875927422368896:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789024146.504603:0:15354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789024146.504612:0:15354:0:(import.c:65:import_set_state_nolock()) ffff90cb033f7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789024146.504644:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90cc415a19c0) has no exports 00000100:00100000:0.0:1789024146.504678:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422368640 00000100:00100000:0.0:1789024146.504685:0:8432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422368640 00000100:00080000:3.0:1789024146.504727:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024146.504736:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789024146.504745:0:8432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875927422368640:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789024146.504838:0:8432:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3467 00000100:00080000:0.0:1789024146.504845:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90cc35389000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789024146.504881:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:3.0:1789024146.504986:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024146.505009:0:8432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875927422368640:12345-0@lo:9:umount.0 Request processed in 264us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024146.505016:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1789024146.505060:0:9521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.505068:0:9521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024146.505094:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024146.505101:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1400/0xa736ef4b98cb3578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa736ef4b98cb357f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024146.505113:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2a60d918-c836-4e5c-bd08-febd347ea726:0:1875927422369152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024146.505128:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024146.505130:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024146.505131:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024146.505210:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422369024:0@lo:9:umount.0 00000100:00100000:2.0:1789024146.505237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789024146.505267:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc34513000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789024146.505275:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789024146.505276:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024146.505279:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422368640:0@lo:9:umount.0 00000100:00100000:2.0:1789024146.505300:0:10202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422369024 00000100:00100000:2.0:1789024146.505304:0:10202:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422369024 00000100:00100000:2.0:1789024146.505326:0:10202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789024146.505333:0:10202:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1875927422369024:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789024146.505345:0:10202:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb35a9 00000100:00080000:2.0:1789024146.505350:0:10202:0:(import.c:65:import_set_state_nolock()) ffff90cb0259e000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789024146.505367:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789024146.505380:0:10202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789024146.505500:0:10202:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3640:x1875927422369024:12345-0@lo:9:umount.0 Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024146.505516:0:10202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789024146.505522:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb033f7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789024146.505529:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789024146.505530:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789024146.505533:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422369024:0@lo:9:umount.0 00010000:00010000:0.0:1789024146.505563:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1789024146.513945:0:6502:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875927422368384 offset 224 length 224: 4 00000100:00100000:1.0:1789024146.513973:0:6502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3644:x1875927422368384:12345-0@lo:103:ldlm_bl.0 Request processed in 33129us (33341us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789024146.513995:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:3.0:1789024146.521640:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90cc415a19c0) has no exports 00000020:01000000:2.0:1789024146.576681:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cb019b6300 - data ffff90cb01c94d80/ffff90cb0331e000 00000020:01000000:2.0:1789024146.576798:0:15354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc0306f420 - data ffff90cc0f634438/ffff90cc3bcfbc00 00000001:00000004:2.0:1789024146.592698:0:15354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789024146.637357:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024146.637370:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789024146.637382:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789024146.639457:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789024146.639466:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789024146.639581:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789024146.639585:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789024146.640747:0:8890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789024146.640763:0:8890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789024146.640781:0:8890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789024146.642323:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789024146.642331:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1789024146.642353:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789024146.642356:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789024146.642716:0:9981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789024146.642721:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789024146.642732:0:9981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789024146.646939:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3284 00000020:00000080:0.0:1789024146.646954:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc4159c000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789024146.647376:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc4159c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789024146.649275:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3299 00000020:00000080:1.0:1789024146.649309:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc4159a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789024146.649336:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789024146.649342:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024146.649354:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789024146.649360:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff90cc30c30000) has no exports 00000020:00000080:2.0:1789024146.649455:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc4159a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1789024146.649606:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789024146.649618:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb35a2 00000020:00000080:1.0:1789024146.649623:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cb033f7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789024146.649639:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789024146.649642:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024146.649651:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789024146.649654:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff90cb02618000) has no exports 00000020:00000080:1.0:1789024146.649661:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb359b 00000020:00000080:2.0:1789024146.649667:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb033f7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789024146.649669:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cb033f4000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789024146.649694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb033f4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789024146.650140:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789024146.650174:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789024146.650181:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789024146.650188:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789024146.650191:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789024146.650241:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024146.650252:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789024146.650259:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3460 00000020:00000080:1.0:1789024146.650265:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cb01a19800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024146.650266:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb033f7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789024146.650282:0:12478:0:(genops.c:885:class_export_put()) final put ffff90cc3bf99800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789024146.650283:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789024146.650290:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf99800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789024146.650297:0:12478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789024146.650302:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024146.650309:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789024146.650315:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff90cc415a3380) has no exports 00000020:00000080:1.0:1789024146.650320:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3459 00000020:00000080:1.0:1789024146.650326:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc34511800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789024146.650449:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb01a19800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789024146.650467:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc34511800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789024146.651740:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789024146.651821:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789024146.651884:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789024146.651894:0:15354:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789024146.651897:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789024146.652036:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024146.652048:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789024146.652071:0:15354:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789024146.652080:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32bc 00000020:00000080:1.0:1789024146.652097:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc3538d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024146.652136:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc34513000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789024146.652168:0:12478:0:(genops.c:885:class_export_put()) final put ffff90cc3bd91800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024146.652173:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bd91800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789024146.652180:0:12478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789024146.652405:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789024146.652412:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024146.652419:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789024146.652424:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff90cc31210000) has no exports 00000020:00000080:1.0:1789024146.652432:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32b5 00000020:00000080:1.0:1789024146.652438:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc346d8800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789024146.652903:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789024146.652911:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc346d8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789024146.654251:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789024146.654259:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789024146.654264:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789024146.654288:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789024146.654378:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024146.654389:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789024146.654449:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024146.654455:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789024146.654461:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc414b0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024146.654466:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc414b0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789024146.654474:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789024146.654683:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32a0 00000020:00000080:0.0:1789024146.654691:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc4159e800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789024146.654696:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789024146.654701:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024146.654706:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789024146.654711:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff90cc415a4d40) has no exports 00000020:00000080:0.0:1789024146.654738:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024146.654742:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789024146.654761:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32a7 00000020:00000080:0.0:1789024146.654766:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc41599800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789024146.654777:0:15354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc414b7800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789024146.654781:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc414b7800 2 00000020:01000004:0.0:1789024146.654784:0:15354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cc414b7800 from lustre-MDT0001 00000020:00000080:0.0:1789024146.654804:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024146.654809:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789024146.654812:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc4159a000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789024146.654814:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc4159a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789024146.654835:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789024146.654871:0:15354:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789024146.654876:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789024146.654879:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024146.654883:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789024146.654892:0:15354:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90cc3538c000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789024146.654907:0:15354:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff90cc312119c0) has exports, disconnecting them 00000020:00080000:0.0:1789024146.654913:0:15354:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90cc3538c000), last request at 1789023906 00000020:00000080:0.0:1789024146.654917:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb32fb 00000020:00080000:0.0:1789024146.654933:0:15354:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3538c000): rc 0 00000020:00000080:0.0:1789024146.654937:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc3538c000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789024146.655863:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc346db800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789024146.655877:0:12478:0:(genops.c:885:class_export_put()) final put ffff90cc3121f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789024146.655880:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3121f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789024146.655891:0:12478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789024146.656048:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc4159e800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789024146.656054:0:12478:0:(genops.c:885:class_export_put()) final put ffff90cc4159d800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789024146.656057:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc4159d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789024146.656060:0:12478:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789024146.656284:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc41599800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789024146.656290:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538c000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1789024146.669240:0:15354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1789024146.669253:0:15354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024146.669274:0:15354:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789024146.669283:0:15354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789024146.669350:0:12478:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3538a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789024146.669756:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024146.669770:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789024146.669782:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc3538d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789024146.669787:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3538d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789024146.669797:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1789024146.669901:0:15354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc414b7800 1 00000020:00000080:2.0:1789024146.669910:0:15354:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3237 00000020:00000080:2.0:1789024146.669921:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc346db000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1789024146.669935:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1789024146.669956:0:12478:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc346db000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789024146.669973:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024146.669981:0:15354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789024146.669987:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff90cc30c33380) has no exports 00000020:00000080:2.0:1789024146.736663:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024146.736681:0:15354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789024146.736688:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc414b6000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789024146.736692:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc414b6000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789024146.736704:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789024146.736842:0:15354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90cc414b0800 00000020:01000000:2.0:1789024146.736865:0:15354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789024146.736870:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024146.736873:0:15354:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789024146.736878:0:15354:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff90cc31213380) has no exports 00000100:00100000:3.0:1789024146.737616:0:6517:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff90cc1921b000:6517] 2 exiting: rc = 0 00000100:00100000:3.0:1789024146.737803:0:6516:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff90cc198b8a00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1789024146.738714:0:13818:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff90cc3bf4ac00:13818] 4 exiting: rc = 0 00000100:00100000:1.0:1789024146.739238:0:6515:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff90cc198b9400:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1789024146.739330:0:7824:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff90cc35228c00:7824] 3 exiting: rc = 0 00000100:00100000:2.0:1789024146.739500:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739515:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739523:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739531:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739539:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739567:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739575:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739585:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739593:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739615:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739622:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739628:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739635:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739641:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739648:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739655:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739662:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739670:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739677:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739683:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739690:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739697:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739703:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739710:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739724:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739732:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739740:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739747:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739753:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739759:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739765:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739773:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739780:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739789:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739798:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739805:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739814:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739823:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.739844:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740055:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740066:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740078:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740086:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740107:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740115:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740122:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740129:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740137:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740143:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740190:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740199:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740208:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740219:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740237:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740249:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740255:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740263:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740270:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740276:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740283:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740292:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740302:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.740313:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.749464:0:6518:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90cc0f22ec00:6518] 0 exiting: rc = 1 00000100:00100000:0.0:1789024146.751369:0:6519:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90cc19a4ac00:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1789024146.751477:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751498:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751508:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751516:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751523:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751531:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751538:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751547:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751553:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751560:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751588:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751606:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751614:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751621:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751627:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751634:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751646:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751652:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751659:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751665:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751673:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751679:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751685:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751691:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751697:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751704:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751710:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751716:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751722:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751727:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751733:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751739:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751745:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751752:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751758:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751764:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751771:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751776:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751783:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751789:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751794:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751802:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751808:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751814:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751845:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751852:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751857:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751863:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751869:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751875:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751881:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751887:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751892:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751898:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751903:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751909:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751915:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751921:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751927:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751933:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751939:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751945:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.751953:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.753543:0:7823:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff90cc346f4400:7823] 2 exiting: rc = 0 00000100:00100000:3.0:1789024146.753707:0:6521:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff90cc2c322200:6521] 1 exiting: rc = 0 00000100:00100000:2.0:1789024146.754025:0:6520:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff90cc2c322c00:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1789024146.754295:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754309:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754328:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754336:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754342:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754352:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754359:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754366:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754384:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754391:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754409:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754418:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754425:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754433:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754457:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754483:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754490:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754497:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754505:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754514:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754523:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754530:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754540:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754546:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754553:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754561:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754588:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754597:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754604:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754611:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754618:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754626:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754633:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754647:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754654:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754661:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754668:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754689:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754697:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754704:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754712:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754721:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754729:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754738:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754749:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754756:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754763:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754771:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754777:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754805:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754815:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754822:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754963:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754973:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754979:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754987:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.754994:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755001:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755009:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755016:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755024:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755031:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.755040:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.769972:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90cc067e8000:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1789024146.770209:0:6522:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90cc0a70ca00:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1789024146.770336:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770344:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770367:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770374:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770381:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770388:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770403:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770410:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770416:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770422:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770428:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770434:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770440:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770445:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770451:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770457:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770463:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770470:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770477:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770482:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770487:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770494:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770500:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770505:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770527:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770534:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770539:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770545:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770550:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770556:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770562:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770568:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770573:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770579:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770585:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770592:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770597:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770603:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770609:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770616:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770622:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770627:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770634:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770640:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770645:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770651:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770658:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770665:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770671:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770676:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770683:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770688:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770694:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770699:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770705:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770711:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770717:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770723:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770729:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770742:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770748:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770753:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770759:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.770765:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024146.771375:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90cc0885e400:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1789024146.771781:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90cc03a1d800:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1789024146.771947:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771956:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771962:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771969:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771975:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771981:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771988:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.771995:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772001:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772008:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772014:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772020:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772026:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772032:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772037:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772043:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772049:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772055:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772061:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772066:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772072:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772078:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772085:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772090:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772096:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772102:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772109:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772116:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772122:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772128:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772363:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772370:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772376:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772382:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772388:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772404:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772410:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772415:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772422:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772428:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772434:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772440:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772446:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772453:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772460:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772466:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772473:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772479:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772485:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772492:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772498:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772504:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772510:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772516:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772522:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772528:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772534:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772540:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772546:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772552:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772558:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772564:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772570:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.772577:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789024146.773693:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff90cc1999d600:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1789024146.773969:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff90cc0885f000:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1789024146.774051:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774060:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774066:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774072:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774078:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774084:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774099:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774106:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774112:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774117:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774123:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774129:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774136:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774141:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774378:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774385:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774390:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774409:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774415:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774421:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774426:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774431:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774437:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774442:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774447:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774452:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774458:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774464:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774469:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774475:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774481:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774487:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774493:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774499:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774506:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774512:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774517:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774524:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774530:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774537:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774542:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774556:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774562:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774567:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774573:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774579:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774586:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774591:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774597:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774603:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774609:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774615:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774620:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774626:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774632:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774637:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774644:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774651:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774657:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774662:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774668:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774675:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774681:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.774687:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789024146.775927:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff90cc1999c400:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1789024146.776566:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff90cc1999ca00:6530] 2 exiting: rc = 0 00000100:00100000:0.0:1789024146.777503:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff90cc1999d800:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1789024146.777941:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777949:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777954:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777959:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777970:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777976:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777980:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777985:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777991:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.777995:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778000:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778015:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778019:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778024:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778028:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778032:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778036:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778040:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778045:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778049:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778053:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778071:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778077:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778081:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778085:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778089:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778094:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778098:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778102:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778106:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778110:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778113:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778116:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778120:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778123:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778127:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778131:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778136:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778140:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778270:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778277:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778282:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778286:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778290:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778295:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778309:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778318:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778323:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778327:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778331:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778336:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778340:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778344:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778348:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778352:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778356:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778360:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778365:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778369:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778373:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778377:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778381:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778385:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024146.778389:0:15354:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789024146.782711:0:15354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024146.782731:0:15354:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789024146.782739:0:15354:0:(genops.c:885:class_export_put()) final put ffff90cc3121c800/MDS_uuid 00000020:00000080:0.0:1789024146.782745:0:15354:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3121c800/MDS_uuid for MDS 00000020:01000000:0.0:1789024146.782753:0:15354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789024146.782964:0:15354:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789024147.340539:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024148.373525:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024149.389353:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789024150.413523:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024150.413536:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789024150.413539:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024150.413543:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789024150.413549:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024150.413559:0:12478:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1789024150.413567:0:12478:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789024150.413583:0:12478:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90cc3543f800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024150.413629:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9efb80 x1875927422369280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024150.413676:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024150.413691:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789024150.413693:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024150.413697:0:12478:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1789024150.413701:0:12478:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789024150.413707:0:12478:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90cc3bf9b000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024150.413733:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9ee300 x1875927422369536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789024150.413980:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422369280:0@lo:38:kworker.0 00000400:00000100:3.0:1789024150.414041:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369280 offset 0 length 520: 4 00000100:00100000:3.0:1789024150.414101:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422369536:0@lo:38:kworker.0 00000400:00000100:3.0:1789024150.414117:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369536 offset 0 length 520: 4 00000100:00100000:3.0:1789024150.414176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422369408:0@lo:400:kworker.0 00000400:00000100:3.0:1789024150.414197:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369408 offset 0 length 224: 4 00000100:00100000:3.0:1789024150.414243:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422369664:0@lo:400:kworker.0 00000400:00000100:3.0:1789024150.414262:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369664 offset 0 length 224: 4 00010000:00010000:0.0:1789024150.415329:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789024150.487696:0:15555:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789024150.509487:0:15555:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789024150.509569:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024150.509588:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024150.509620:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024150.509628:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024150.509653:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789024150.509659:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789024150.509689:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024150.509705:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9efb80 x1875927422369280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789024165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024150.509806:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789024150.509815:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789024150.509824:0:15555:0:(import.c:65:import_set_state_nolock()) ffff90cc3543f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789024150.509830:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789024150.509834:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9efb80 x1875927422369280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789024165 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789024150.509841:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789024150.509841:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789024150.509844:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789024150.509849:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024150.509857:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db1000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:3.0:1789024150.509862:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024150.509873:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024150.509893:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024150.509900:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024150.509903:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789024150.509906:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789024150.509922:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:3.0:1789024150.509927:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024150.509934:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db1000/0xa736ef4b98cb3682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3689 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024150.509947:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024150.509949:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024150.509951:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024150.510027:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422369280:0@lo:38:kworker.0 00000100:00080000:2.0:1789024150.511316:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789024150.511332:0:15555:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ed500 x1875927422369408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024166 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024150.511367:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789024150.511373:0:15555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789024150.511404:0:15555:0:(import.c:65:import_set_state_nolock()) ffff90cb021fc000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789024150.511478:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422369408:0@lo:400:kworker.0 00000100:00100000:0.0:1789024150.511514:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422369792:0@lo:39:umount.0 00000400:00000100:0.0:1789024150.511582:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369792 offset 0 length 224: 4 00010000:00010000:1.0:1789024151.437186:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789024151.438796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789024151.438809:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789024151.438814:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789024151.438818:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024151.439179:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422369920:0@lo:400:kworker.0 00000400:00000100:1.0:1789024151.439256:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422369920 offset 0 length 224: 4 00000001:00100000:2.0:1789024151.951433:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789024151.951458:0:8426:0:(genops.c:885:class_export_put()) final put ffff90cc34516000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789024151.951745:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc34516000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789024151.951819:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc35389000 for lustre-OST0000 00000001:00100000:1.0:1789024151.962514:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789024151.962524:0:9511:0:(genops.c:885:class_export_put()) final put ffff90cb0259c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789024151.962636:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0259c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789024151.962693:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb0259e000 for lustre-OST0001 00010000:00010000:3.0:1789024152.460458:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024153.484456:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024154.508351:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789024155.468330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024155.468347:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789024155.468351:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024155.468355:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024155.471672:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789024155.471705:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422370048:0@lo:400:kworker.0 00000400:00000100:1.0:1789024155.471766:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422370048 offset 0 length 224: 4 00010000:00010000:1.0:1789024155.539019:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024156.556969:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024156.685573:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024146/real 1789024146] req@ffff90cc3f9eca80 x1875927422368768/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789024156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024156.685606:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9eca80 x1875927422368768/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789024156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789024156.685627:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789024156.685663:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789024156.685666:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422368768:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789024156.685791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789024156.685805:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789024156.685808:0:37:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024156.685819:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1789024156.685824:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.118@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789024156.685839:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.118@tcp: import ffff90cc18a7e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024156.685879:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3faba680 x1875927422370176/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024156.686011:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789024156.686016:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789024156.686280:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422370176:0@lo:250:kworker.0 00000400:00000100:0.0:1789024156.686339:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927422370176 offset 0 length 520: 4 00000100:00100000:3.0:1789024156.686537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422370304:0@lo:400:kworker.0 00000400:00000100:3.0:1789024156.686566:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422370304 offset 0 length 224: 4 00010000:00010000:0.0:1789024157.583551:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024158.604431:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024159.628560:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024160.652347:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024160.782484:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024150/real 1789024150] req@ffff90cb03bed500 x1875927422369792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789024160 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024160.782517:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cb03bed500 x1875927422369792/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789024160 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789024160.782539:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb021fc000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789024160.782869:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422369792:0@lo:39:umount.0 00000100:00080000:2.0:1789024160.782932:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789024160.782937:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789024160.782941:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789024160.786011:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.786031:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.786037:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.786044:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.790384:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024160.790406:0:15555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.790418:0:15555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.790425:0:15555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024160.790432:0:15555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790709:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024160.790717:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790725:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161400 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024160.790729:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790738:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024160.790745:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024160.790750:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789024160.790753:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1789024160.790765:0:9520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:1.0:1789024160.790769:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790776:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a161400/0xa736ef4b98cb3690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3697 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790800:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024160.790803:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790809:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55a00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024160.790812:0:9520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790818:0:9520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024160.790825:0:9520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024160.790831:0:9520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789024160.790833:0:9520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789024160.790838:0:9520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:1.0:1789024160.790841:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024160.790847:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024160.790849:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024160.790850:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024160.792589:0:15555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789024160.792600:0:15555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a55a00/0xa736ef4b98cb38f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb38ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024160.792617:0:15555:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789024160.792625:0:15555:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789024160.792628:0:15555:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789024160.792660:0:15555:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789024160.792664:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789024160.792671:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024160.792677:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789024160.792681:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff90cc35450000) has no exports 00000020:00080000:2.0:1789024160.792704:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff90cc35450000) has no exports 00010000:00010000:3.0:1789024160.802336:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789024160.802859:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cb031df5a0 - data ffff90cc0f5b0a20/ffff90cb032ca800 00000020:01000000:2.0:1789024160.802979:0:15555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc34799240 - data ffff90cc0f6b5af8/ffff90cc3bdb8400 00100000:10000000:2.0:1789024160.828432:0:15555:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789024160.846606:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb33d4 00000020:00000080:2.0:1789024160.846962:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cb01a1b000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789024160.850240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb01a1b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1789024160.850314:0:15555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc3bd3a000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789024160.850319:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc3bd3a000 2 00000020:01000004:0.0:1789024160.850323:0:15555:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cc3bd3a000 from lustre-OST0000 00000020:00000080:0.0:1789024160.850352:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024160.850364:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789024160.850369:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cc3544a800/lustre-OST0000_UUID 00000020:00000080:0.0:1789024160.850371:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3544a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789024160.850378:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789024160.850503:0:15555:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789024160.850508:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789024160.850512:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024160.850518:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789024160.850524:0:15555:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90cc3543c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789024160.850530:0:15555:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff90cb020a99c0) has exports, disconnecting them 00000020:00080000:0.0:1789024160.850535:0:15555:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90cc3543c000), last request at 1789023927 00000020:00000080:0.0:1789024160.850539:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb33fe 00000020:00080000:0.0:1789024160.850557:0:15555:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3543c000): rc 0 00000020:00000080:0.0:1789024160.850563:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cc3543c000/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789024160.852675:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789024160.852682:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789024160.852686:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789024160.852692:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789024160.852758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3543c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789024160.853284:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024160.853293:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789024160.853307:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789024160.853311:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024160.853315:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789024160.853321:0:15555:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90cb021fb000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789024160.853327:0:15555:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff90cb020acd40) has exports, disconnecting them 00000020:00080000:1.0:1789024160.853332:0:15555:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90cb021fb000), last request at 1789023927 00000020:00000080:1.0:1789024160.853336:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3413 00000020:00080000:1.0:1789024160.853347:0:15555:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cb021fb000): rc 0 00000020:00000080:1.0:1789024160.853352:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cb021fb000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789024160.854414:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3543f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789024160.854423:0:36:0:(genops.c:885:class_export_put()) final put ffff90cc3543c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789024160.854425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3543c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789024160.854434:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789024160.854502:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb021fb000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789024160.904346:0:15555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789024160.904357:0:15555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789024160.904362:0:15555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789024160.904370:0:15555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789024160.904411:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cb021fc000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789024160.904593:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024160.904602:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789024160.904616:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cc3543b800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789024160.904620:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3543b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789024160.904630:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789024160.904690:0:15555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc3bd3a000 1 00000020:00000080:2.0:1789024160.904696:0:15555:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb339c 00000020:00000080:2.0:1789024160.904701:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cc35448800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789024160.904709:0:15555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789024160.904716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc35448800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789024160.904724:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789024160.904728:0:15555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789024160.904732:0:15555:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff90cc35454d40) has no exports 00000020:00000080:2.0:1789024160.940059:0:15555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789024160.940081:0:15555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789024160.940089:0:15555:0:(genops.c:885:class_export_put()) final put ffff90cc3455b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789024160.940094:0:15555:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3455b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789024160.940110:0:15555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789024160.940302:0:15555:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90cc31219000 00000020:02000400:2.0:1789024160.940358:0:15555:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789024161.677617:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789024162.195105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789024162.195115:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789024162.195119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789024162.195122:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024162.195277:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422370432:0@lo:400:kworker.0 00000400:00000100:1.0:1789024162.195333:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422370432 offset 0 length 224: 4 00010000:00010000:3.0:1789024162.700442:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024163.725738:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024164.758286:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789024165.274968:0:15757:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789024165.289385:0:15757:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789024165.289482:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024165.289496:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024165.289502:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024165.289509:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024165.289535:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789024165.289540:0:15757:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789024165.289564:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789024165.289575:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ee300 x1875927422369536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789024165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.289609:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789024165.289616:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789024165.289622:0:15757:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789024165.289628:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789024165.289632:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ee300 x1875927422369536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789024165 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.289639:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789024165.289642:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789024165.289724:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422369536:0@lo:38:kworker.0 00000100:00080000:3.0:1789024165.290651:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789024165.290664:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ed180 x1875927422369664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024166 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.290686:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3fae3100 x1875927422369920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024167 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.290704:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ed500 x1875927422370048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.290716:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3fab8380 x1875927422370304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.290723:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3fae0000 x1875927422370432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024165.290729:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789024165.290759:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875927422369920:0@lo:400:kworker.0 00000100:00100000:3.0:1789024165.290790:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422370304:0@lo:400:kworker.0 00000100:00100000:3.0:1789024165.290797:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875927422370048:0@lo:400:kworker.0 00000100:00080000:3.0:1789024165.290814:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789024165.290843:0:15757:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789024165.290925:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422370560:0@lo:39:umount.0 00000400:00000100:0.0:1789024165.290973:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927422370560 offset 0 length 224: 4 00000100:00100000:0.0:1789024165.291038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422370432:0@lo:400:kworker.0 00000100:00100000:0.0:1789024165.291046:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422369664:0@lo:400:kworker.0 00010000:00010000:1.0:1789024165.291113:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024165.291122:0:9521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024165.291130:0:9521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc15db0e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024165.291134:0:9521:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024165.291171:0:9521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024165.291179:0:9521:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024165.291185:0:9521:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789024165.291187:0:9521:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789024165.291190:0:9521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789024165.291210:0:9521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:1.0:1789024165.291215:0:9521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024165.291233:0:9521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc15db0e00/0xa736ef4b98cb365f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb3666 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024165.291246:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024165.291248:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024165.291249:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024165.773960:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024166.797835:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789024167.309568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789024167.309580:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789024167.820304:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024168.846416:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024169.869824:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024170.892553:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024171.468388:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024156/real 1789024156] req@ffff90cc3faba680 x1875927422370176/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789024171 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024171.468438:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3faba680 x1875927422370176/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789024171 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789024171.468465:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789024171.468504:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789024171.468508:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422370176:0@lo:250:kworker.0 00000100:00080000:3.0:1789024171.468816:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2a60d918-c836-4e5c-bd08-febd347ea726->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789024171.468824:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789024171.468827:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024171.468834:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 474 00000100:00080000:3.0:1789024171.468840:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.118@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789024171.468857:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.118@tcp: import ffff90cc18a7e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024171.468916:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9ed180 x1875927422370688/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789024171.473710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422370688:0@lo:250:kworker.0 00000400:00000100:0.0:1789024171.475223:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927422370688 offset 0 length 520: 4 00010000:00010000:0.0:1789024171.922880:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024172.943868:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024173.965781:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024174.991263:0:9520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024175.564258:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024165/real 1789024165] req@ffff90cc3f9ed500 x1875927422370560/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789024175 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024175.564294:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9ed500 x1875927422370560/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789024175 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789024175.564336:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf9f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789024175.564358:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422370560:0@lo:39:umount.0 00000100:00080000:3.0:1789024175.564493:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789024175.564498:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789024175.564503:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789024175.565460:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565474:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565482:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565489:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565516:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024175.565533:0:15757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565539:0:15757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565546:0:15757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565551:0:15757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.565570:0:15757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789024175.565575:0:15757:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789024175.565601:0:15757:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789024175.565605:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789024175.565609:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789024175.565615:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789024175.565619:0:15757:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff90cb0261cd40) has no exports 00000020:00080000:3.0:1789024175.565641:0:15757:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff90cb0261cd40) has no exports 00000020:01000000:3.0:1789024175.567315:0:15757:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cc35419b40 - data ffff90cc0f6f9438/ffff90cb03326000 00000020:01000000:3.0:1789024175.567446:0:15757:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90cb019b66c0 - data ffff90cb01ceae58/ffff90cc3bf90000 00010000:00010000:0.0:1789024175.567953:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024175.567965:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.567977:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01489200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024175.567982:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.567993:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024175.568000:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024175.568005:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789024175.568008:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789024175.568011:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789024175.568028:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:0.0:1789024175.568031:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568038:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01489200/0xa736ef4b98cb3674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb367b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568049:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024175.568053:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568070:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb03a55e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024175.568073:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568080:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024175.568086:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024175.568091:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789024175.568094:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789024175.568096:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789024175.568102:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:0.0:1789024175.568105:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568111:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb03a55e00/0xa736ef4b98cb38ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb38f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024175.568134:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024175.568136:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024175.568137:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024175.569311:0:9521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789024175.581979:0:15757:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789024175.606064:0:15757:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb34fa 00000020:00000080:3.0:1789024175.606082:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3bf9b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789024175.606107:0:15757:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cb021fb800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789024175.606111:0:15757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb021fb800 2 00000020:01000004:3.0:1789024175.606114:0:15757:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90cb021fb800 from lustre-OST0001 00000020:00000080:3.0:1789024175.606170:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789024175.606181:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789024175.606184:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3bf9d000/lustre-OST0001_UUID 00000020:00000080:3.0:1789024175.606198:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf9d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789024175.606206:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789024175.606310:0:15757:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2a60d918-c836-4e5c-bd08-febd347ea726->MGS 00010000:00010000:3.0:1789024175.606324:0:15757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4800/0xa736ef4b98cb3253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024175.606337:0:15757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4800/0xa736ef4b98cb3253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024175.606344:0:15757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789024175.606347:0:15757:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789024175.606351:0:15757:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789024175.606370:0:15757:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:3.0:1789024175.606374:0:15757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa4800/0xa736ef4b98cb3253 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb325a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024175.606389:0:15757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789024175.606396:0:15757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024175.606402:0:15757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789024175.606404:0:15757:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789024175.606406:0:15757:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789024175.606420:0:15757:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90cc18a7e800 00010000:00010000:3.0:1789024175.606424:0:15757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc1a161000/0xa736ef4b98cb36d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa736ef4b98cb36dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789024175.606442:0:15757:0:(import.c:65:import_set_state_nolock()) ffff90cc18a7e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789024175.606447:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789024175.606454:0:15757:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789024175.606456:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789024175.606461:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000020:00000080:1.0:1789024175.606577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf9b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1789024175.606628:0:15757:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90cc3f9ed180 x1875927422370688/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789024191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789024175.606652:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789024175.606655:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1789024175.606727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2a60d918-c836-4e5c-bd08-febd347ea726:3640:1875927422370688:0@lo:250:kworker.0 10000000:01000000:1.0:1789024175.606752:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789024175.606760:0:15757:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3150 00000020:00000080:1.0:1789024175.606764:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc22c2c000/2a60d918-c836-4e5c-bd08-febd347ea726 00000020:01000000:1.0:1789024175.606781:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.118@tcp (flags='') 00000020:00000080:1.0:1789024175.606786:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024175.606790:0:15757:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.118@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789024175.606794:0:15757:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff90cc339999c0) has no exports 10000000:01000000:1.0:1789024175.606819:0:6512:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789024175.606860:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.118@tcp: client import never connected 00000100:00080000:1.0:1789024175.606862:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789024175.606865:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789024175.606866:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789024175.606868:0:15757:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789024175.606899:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789024175.606910:0:15757:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.118@tcp (uuid 2a60d918-c836-4e5c-bd08-febd347ea726) 00000020:01000000:1.0:1789024175.606915:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789024175.606917:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789024175.606921:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789024175.606926:0:15757:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90cc3bf99000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789024175.606931:0:15757:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff90cc344ecd40) has exports, disconnecting them 00000020:00080000:1.0:1789024175.606936:0:15757:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90cc3bf99000), last request at 1789023947 00000020:00000080:1.0:1789024175.606940:0:15757:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3524 00000020:00080000:1.0:1789024175.606951:0:15757:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3bf99000): rc 0 00000020:00000080:1.0:1789024175.606955:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3bf99000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789024175.607713:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc22c2c000/2a60d918-c836-4e5c-bd08-febd347ea726 for MGC192.168.202.118@tcp 00000020:00000080:3.0:1789024175.607722:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc18a7e800 for MGC192.168.202.118@tcp 00000020:00000080:3.0:1789024175.607727:0:36:0:(genops.c:885:class_export_put()) final put ffff90cc18a78800/2a60d918-c836-4e5c-bd08-febd347ea726 00000020:00000080:3.0:1789024175.607729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc18a78800/2a60d918-c836-4e5c-bd08-febd347ea726 for MGC192.168.202.118@tcp 00000020:01000000:3.0:1789024175.607732:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.118@tcp (2a60d918-c836-4e5c-bd08-febd347ea726) 00000020:00000080:3.0:1789024175.607951:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf99000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789024175.608082:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789024175.608085:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789024175.608088:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789024175.608093:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789024175.608284:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789024175.608289:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789024175.608298:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789024175.608301:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789024175.608305:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789024175.608310:0:15757:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90cc3d4b7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789024175.608315:0:15757:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff90cb0261b380) has exports, disconnecting them 00000020:00080000:0.0:1789024175.608318:0:15757:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90cc3d4b7000), last request at 1789023947 00000020:00000080:0.0:1789024175.608321:0:15757:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb3539 00000020:00080000:0.0:1789024175.608331:0:15757:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90cc3d4b7000): rc 0 00000020:00000080:0.0:1789024175.608335:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3d4b7000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789024175.609134:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3bf9b000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789024175.609141:0:36:0:(genops.c:885:class_export_put()) final put ffff90cb0259f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789024175.609143:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb0259f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789024175.609164:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789024175.609203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3d4b7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789024175.635255:0:15757:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789024175.635268:0:15757:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789024175.635273:0:15757:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789024175.635283:0:15757:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789024175.635333:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90cc3bf9f000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789024175.635392:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789024175.635547:0:9520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789024175.639228:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789024175.643180:0:9521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1789024175.643385:0:6499:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90cc07574000:6499] 1 exiting: rc = 0 00000100:00100000:1.0:1789024175.643385:0:6498:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90cc199f8a00:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1789024175.643517:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.643765:0:6501:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90cc0a799600:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.643831:0:6500:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90cc034dd200:6500] 0 exiting: rc = 1 00000100:00100000:1.0:1789024175.653159:0:6502:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90cc07df5a00:6502] 2 exiting: rc = 0 00000100:00100000:3.0:1789024175.664302:0:7924:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90cc41529e00:7924] 3 exiting: rc = 0 00000100:00100000:3.0:1789024175.664420:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664428:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664435:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664441:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664448:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664455:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664461:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664468:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664489:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664502:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664509:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664515:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664521:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664527:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664533:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664539:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664545:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664551:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664557:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664571:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664579:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664584:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664589:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664594:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664600:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664605:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664610:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664616:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664621:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664627:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664632:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664638:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664643:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664661:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664667:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664672:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664677:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664683:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664688:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664693:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664699:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664703:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664708:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664713:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664719:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664724:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664729:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664733:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664739:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664744:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664749:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664754:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664760:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664766:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664771:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664777:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664782:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664788:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664792:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664798:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664804:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664810:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664815:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.664821:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789024175.670194:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789024175.670208:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789024175.670215:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3bf9e000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789024175.670220:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3bf9e000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789024175.670237:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789024175.670301:0:15757:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb021fb800 1 00000020:00000080:3.0:1789024175.670306:0:15757:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa736ef4b98cb34c9 00000020:00000080:3.0:1789024175.670314:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc35388000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789024175.670334:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789024175.670355:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc35388000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789024175.670370:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789024175.670375:0:15757:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789024175.670379:0:15757:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff90cb020ab380) has no exports 00000020:00000080:3.0:1789024175.734683:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789024175.734705:0:15757:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789024175.734714:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cb021f9000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789024175.734721:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff90cb021f9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789024175.734729:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789024175.736138:0:15757:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90cb021f8000 00000020:01000000:3.0:1789024175.736207:0:15757:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789024175.736217:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789024175.736223:0:15757:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789024175.736228:0:15757:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff90cc35453380) has no exports 00000020:00000080:3.0:1789024175.736255:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789024175.736265:0:15757:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789024175.736270:0:15757:0:(genops.c:885:class_export_put()) final put ffff90cc3544e800/OSS_uuid 00000020:00000080:3.0:1789024175.736274:0:15757:0:(genops.c:844:class_export_destroy()) destroying export ffff90cc3544e800/OSS_uuid for OSS 00000020:01000000:3.0:1789024175.736279:0:15757:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789024175.736416:0:6511:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789024175.748427:0:10202:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff90cc3d4d5600:10202] 4 exiting: rc = 0 00000100:00100000:2.0:1789024175.748540:0:8904:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff90cb01947000:8904] 3 exiting: rc = 0 00000100:00100000:2.0:1789024175.748586:0:8433:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff90cc346d4a00:8433] 2 exiting: rc = 0 00000100:00100000:3.0:1789024175.760084:0:8431:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff90cc34519800:8431] 0 exiting: rc = 1 00000100:00100000:3.0:1789024175.760953:0:8432:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff90cc346a8000:8432] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.761057:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761066:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761075:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761084:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761089:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761106:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761110:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761117:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761133:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761139:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761170:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761177:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761182:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761188:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761193:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761198:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761204:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761209:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761226:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761232:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761238:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761243:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761249:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761254:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761259:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761271:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761281:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761286:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761302:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761307:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761311:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761317:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761322:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761328:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761333:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761338:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761343:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761348:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761353:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761358:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761368:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761377:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761384:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761389:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761393:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761398:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761403:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761408:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761413:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761419:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761424:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761430:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761442:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761449:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761455:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761460:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761466:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761472:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761477:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761482:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761487:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761492:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761497:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.761502:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762425:0:11084:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90cb02081a00:11084] 2 exiting: rc = 0 00000100:00100000:3.0:1789024175.762500:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90cc355a0800:8434] 0 exiting: rc = 1 00000100:00100000:3.0:1789024175.762552:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90cc34696800:8435] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.762600:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762608:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762614:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762620:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762625:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762631:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762637:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762651:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762657:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762663:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762669:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762675:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762680:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762685:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762691:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762697:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762703:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762709:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762716:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762722:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762727:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762756:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762763:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762769:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762774:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762780:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762785:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762791:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762796:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762802:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762808:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762814:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762820:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762825:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762831:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762836:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762841:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762847:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762852:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762857:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762862:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762867:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762879:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762885:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762891:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762896:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762901:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762907:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762911:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762916:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762922:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762927:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762932:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762937:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762943:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762948:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762953:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762957:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762963:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762968:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762973:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762978:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762983:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.762993:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.763957:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90cc0f22e400:8436] 0 exiting: rc = 1 00000100:00100000:2.0:1789024175.776008:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90cc346f0c00:8438] 2 exiting: rc = 0 00000100:00100000:3.0:1789024175.776243:0:8437:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90cc346f1600:8437] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.776324:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776332:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776338:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776344:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776349:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776354:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776360:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776365:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776371:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776376:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776390:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776404:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776409:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776415:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776420:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776426:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776432:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776438:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776443:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776450:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776455:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776461:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776467:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776473:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776478:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776484:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776490:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776496:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776501:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776507:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776512:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776518:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776523:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776529:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776548:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776555:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776561:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776567:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776572:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776578:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776583:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776589:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776594:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776600:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776606:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776611:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776625:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776630:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776635:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776641:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776646:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776653:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776659:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776664:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776669:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776674:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776679:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776684:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776689:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776695:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776701:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776707:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776712:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.776725:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.785606:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90cc346f0400:8439] 0 exiting: rc = 1 00000100:00100000:2.0:1789024175.796192:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90cc3bc70400:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.830310:0:8894:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff90cb020a6e00:8894] 2 exiting: rc = 0 00000100:00100000:3.0:1789024175.830449:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830457:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830462:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830512:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830519:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830524:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830529:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830534:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830539:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830545:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830550:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830555:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830560:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830565:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830570:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830588:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830593:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830597:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830603:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830607:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830613:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830618:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830623:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830628:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830634:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830646:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830653:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830660:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830665:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830670:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830676:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830680:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830685:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830691:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830696:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830701:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830706:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830711:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830715:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830720:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830725:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830730:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830735:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830741:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830751:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830758:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830764:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830774:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830780:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830785:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830797:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830802:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830807:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830811:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830816:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830825:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830832:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830837:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830842:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830846:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830852:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830857:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830862:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.830868:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789024175.831735:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90cc355d3e00:8441] 0 exiting: rc = 1 00000100:00100000:2.0:1789024175.831952:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90cc355d2c00:8442] 1 exiting: rc = 0 00000100:00100000:3.0:1789024175.832076:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832084:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832090:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832097:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832130:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832140:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832163:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832170:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832177:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832184:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832191:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832198:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832206:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832213:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832221:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832228:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832251:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832259:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832265:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832271:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832278:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832296:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832302:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832309:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832317:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832324:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832330:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832336:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832356:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832364:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832370:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832377:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832386:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832392:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832398:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832405:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832413:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832418:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832425:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832431:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832453:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832460:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832466:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832471:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832478:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832484:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832490:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832495:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832502:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832508:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832515:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832521:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832540:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832548:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832554:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832560:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832573:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832579:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832585:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832593:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832601:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832607:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832615:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789024175.832624:0:15757:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789024175.843305:0:15757:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789024198.950126:0:16521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789024211.147136:0:17122:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789024211.147210:0:17122:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789024211.147212:0:17122:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789024211.147351:0:17122:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cb0401f000 00000020:01000004:3.0:1789024211.147376:0:17122:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789024211.147387:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789024211.147525:0:17122:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90cb020ab380) 00000020:00000080:3.0:1789024211.147548:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789024211.305407:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789024211.311497:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789024211.314977:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.315470:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.315878:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.316080:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.316404:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.316599:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789024211.318229:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789024211.318473:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789024211.318865:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.319060:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789024211.320400:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789024211.320827:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789024211.321008:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789024211.356211:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789024211.356848:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789024211.357126:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789024211.362230:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789024211.365062:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789024211.366290:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789024211.366699:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789024211.367109:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789024211.367412:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789024211.367706:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789024211.368287:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789024211.368698:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789024211.374770:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789024211.377079:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789024211.378560:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.379456:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.379851:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.380104:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.380432:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.381193:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.381717:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.382244:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.382474:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.385973:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.387123:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.387486:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.387955:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.388237:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.388447:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.388727:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.388953:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789024211.389739:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789024211.394354:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1789024211.396007:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789024211.396368:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1789024211.397861:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789024211.398283:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1789024211.405617:0:17122:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1789024211.409324:0:17122:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789024211.410934:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789024211.410953:0:17122:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789024211.410972:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb46ff 00000020:01000004:2.0:1789024211.410981:0:17122:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789024211.410985:0:17122:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789024211.412249:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cb0401f000 from MGS 00000020:01000004:2.0:1789024211.412257:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789024211.412275:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90cc35454d40) 00000020:00000080:2.0:1789024211.412294:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789024211.412373:0:17122:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb0401f000 from MGS, refs=2 00080000:01000000:2.0:1789024211.412380:0:17122:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789024211.412386:0:17122:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb470d 00000100:00100000:2.0:1789024211.412532:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789024211.418235:0:17122:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789024211.418248:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789024211.421452:0:17122:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789024211.421475:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789024211.426546:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024211.427068:0:17122:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789024211.427076:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789024211.432483:0:17122:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789024211.432506:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789024211.435828:0:17122:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789024211.435857:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789024211.443385:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024211.443392:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024211.443394:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024211.443936:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024211.443938:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024211.443940:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024211.446418:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789024211.446793:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789024211.465194:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789024211.468804:0:17134:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789024211.472385:0:17122:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789024211.472449:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789024211.473991:0:17122:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789024211.474381:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789024211.474552:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789024211.474559:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789024211.476709:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789024211.476720:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789024211.477282:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789024211.477289:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789024211.479008:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789024211.479034:0:17122:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.118@tcp' 00000020:01000004:3.0:1789024211.479036:0:17122:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789024211.479072:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.118@tcp (typ=mgc) 00000020:00000080:3.0:1789024211.479299:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.118@tcp (ffff90cb020a8000) 00000020:00000080:3.0:1789024211.479320:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789024211.479451:0:17122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb0401b000@MGC192.168.202.118@tcp: add connection 192.168.202.118@tcp at head 00000100:00080000:1.0:1789024211.479799:0:17139:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1789024211.480764:0:17122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.118@tcp-0 is initialized 00000040:01000000:3.0:1789024211.480775:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789024211.483689:0:17140:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789024211.488554:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.118@tcp (uuid 5cc9fac3-ff77-40ec-8f57-b6a206d9fd68) 00000020:00000080:0.0:1789024211.488597:0:17122:0:(genops.c:1384:class_connect()) connect: client 5cc9fac3-ff77-40ec-8f57-b6a206d9fd68, cookie 0xa736ef4b98cb471b 00000100:00080000:0.0:1789024211.488753:0:17122:0:(import.c:545:import_select_connection()) MGC192.168.202.118@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789024211.488771:0:17122:0:(import.c:666:import_select_connection()) MGC192.168.202.118@tcp: import ffff90cb0401b000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024211.488823:0:17122:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae0000 x1875927422370816/t0(0) o250->MGC192.168.202.118@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024211.488918:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3640:1875927422370816:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789024211.488981:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024211.489093:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422370816 00000100:00100000:3.0:1789024211.489103:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422370816 00000100:00100000:3.0:1789024211.489179:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789024211.489188:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875927422370816:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789024211.489217:0:17136:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5cc9fac3-ff77-40ec-8f57-b6a206d9fd68@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1789024211.489244:0:17136:0:(genops.c:1384:class_connect()) connect: client 5cc9fac3-ff77-40ec-8f57-b6a206d9fd68, cookie 0xa736ef4b98cb4722 00000100:00080000:3.0:1789024211.489385:0:17136:0:(import.c:65:import_set_state_nolock()) ffff90cb0401c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789024211.489458:0:17122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5cc9fac3-ff77-40ec-8f57-b6a206d9fd68->MGS 00000020:01000004:0.0:1789024211.489478:0:17122:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789024211.489484:0:17122:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789024211.489498:0:17122:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90cb02618000) 00000020:00000080:0.0:1789024211.489508:0:17122:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789024211.492894:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:3640:x1875927422370816:12345-0@lo:250:mount.lustre.0 Request processed in 3694us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024211.492911:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789024211.499932:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.118@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789024211.499947:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.118@tcp: connect to target with instance 0 00000100:00080000:2.0:1789024211.499957:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.118@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789024211.499963:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789024211.499986:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb0401b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789024211.499990:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789024211.500043:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789024211.500056:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3640:1875927422370816:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789024211.500880:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024211.501081:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789024211.501088:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789024211.502553:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789024211.502566:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789024211.503574:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789024211.503587:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789024211.505461:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024211.505873:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789024211.505878:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789024211.506935:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789024211.506944:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789024211.575553:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789024211.575773:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789024211.575791:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789024211.584290:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789024211.584309:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789024211.585206:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024211.585395:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789024211.585402:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789024211.586044:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789024211.586051:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789024211.593798:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789024211.593994:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789024211.594000:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789024211.595071:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789024211.595081:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789024211.596551:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789024211.596766:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789024211.596773:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789024211.597560:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789024211.597572:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789024211.637054:0:17122:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789024211.637526:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789024211.637535:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789024211.639031:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789024211.639047:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789024211.641918:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789024211.641938:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789024211.643956:0:17122:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789024211.644001:0:17122:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789024211.644010:0:17122:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789024211.644392:0:17122:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789024211.644429:0:17122:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.118@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789024211.644434:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789024211.644435:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789024211.644437:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024211.644438:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024211.644440:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024211.644441:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024211.644442:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024211.644444:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789024211.644446:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024211.644447:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789024211.644450:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789024211.644452:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789024211.644453:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789024211.644454:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024211.644455:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024211.644456:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024211.644457:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024211.644458:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024211.644459:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789024211.644459:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024211.644460:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789024211.644489:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789024211.644511:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422370944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789024211.644602:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024211.644652:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc18d43e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789024211.644718:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422370944 00000100:00100000:2.0:1789024211.644727:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422370944 00000100:00100000:2.0:1789024211.644773:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789024211.644792:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:17122:x1875927422370944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789024211.644843:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789024211.644847:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789024211.644850:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789024211.645496:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789024211.645959:0:17138:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789024211.647421:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789024211.647427:0:17160:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789024211.647430:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789024211.647432:0:17160:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789024211.647616:0:17160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789024211.647812:0:17138:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789024211.647824:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789024211.649433:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:17122:x1875927422370944:12345-0@lo:253:mount.lustre.0 Request processed in 4642us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024211.649450:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789024211.649584:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422370944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789024211.649600:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789024211.649604:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789024211.649606:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789024211.649608:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024211.649616:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024211.649617:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024211.649619:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024211.649620:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024211.649622:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789024211.649624:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024211.649626:0:17122:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789024211.649649:0:17122:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cb0401f000 from lustre-MDT0000 10000000:01000000:1.0:1789024211.649682:0:17122:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789024211.649685:0:17122:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789024211.649690:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90cb020a8000 10000000:01000000:1.0:1789024211.649694:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789024211.649702:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90cb020a8000 from 1 10000000:01000000:1.0:1789024211.649706:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789024211.649744:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.649755:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.649764:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024211.649795:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024211.649833:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024211.649873:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc18d433c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024211.649996:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371072 00000100:00100000:3.0:1789024211.650003:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371072 00000100:00100000:3.0:1789024211.650049:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789024211.650059:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:17122:x1875927422371072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789024211.650074:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024211.650089:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0338ba00/0xa736ef4b98cb4737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4730 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024211.650115:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0338ba00/0xa736ef4b98cb4737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4730 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024211.650182:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0338ba00/0xa736ef4b98cb4737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4730 expref: 6 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024211.650191:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338ba00, rc 0) 00000100:00100000:3.0:1789024211.650238:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:17122:x1875927422371072:12345-0@lo:101:mount.lustre.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024211.650244:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789024211.650326:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024211.650339:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024211.650348:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024211.650402:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024211.650430:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024211.650458:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024211.650500:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371200 00000100:00100000:3.0:1789024211.650504:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371200 00000100:00100000:3.0:1789024211.650534:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789024211.650540:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:17122:x1875927422371200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024211.650615:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:17122:x1875927422371200:12345-0@lo:501:mount.lustre.0 Request processed in 75us (184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789024211.650622:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789024211.650733:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371200:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789024211.650767:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789024211.650793:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024211.650802:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024211.650809:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cb0401f000 10000000:01000000:2.0:1789024211.650813:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789024211.650817:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90cb0401f000 10000000:01000000:2.0:1789024211.650819:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789024211.650822:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90cb0401f000 from 1 10000000:01000000:2.0:1789024211.650824:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789024211.650844:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024211.650851:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024211.650864:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024211.650876:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789024211.650899:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024211.650910:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024211.650980:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371328 00000100:00100000:1.0:1789024211.650986:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371328 00000100:00100000:1.0:1789024211.651013:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789024211.651020:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:17122:x1875927422371328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024211.651027:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024211.651039:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01322200/0xa736ef4b98cb4745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb473e expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651062:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01322200/0xa736ef4b98cb4745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb473e expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651071:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01322200/0xa736ef4b98cb4745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb473e expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651078:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322200, rc 0) 00000100:00100000:1.0:1789024211.651112:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+7:17122:x1875927422371328:12345-0@lo:101:mount.lustre.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024211.651119:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789024211.651177:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371328:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024211.651189:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4745 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651197:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4745 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024211.651207:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789024211.651210:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4745 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651216:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c5400/0xa736ef4b98cb473e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4745 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024211.651221:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789024211.651224:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789024211.651228:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90cb0401f000 10000000:01000000:1.0:1789024211.651238:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789024211.651241:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789024211.651243:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789024211.651259:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651265:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651271:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024211.651281:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024211.651305:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024211.651324:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371456 00000100:00100000:1.0:1789024211.651327:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371456 00000100:00100000:1.0:1789024211.651342:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789024211.651346:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+7:17122:x1875927422371456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024211.651352:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024211.651359:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01323000/0xa736ef4b98cb4753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb474c expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651371:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01323000/0xa736ef4b98cb4753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb474c expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651379:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01323000/0xa736ef4b98cb4753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb474c expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651385:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323000, rc 0) 00000100:00100000:1.0:1789024211.651406:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+8:17122:x1875927422371456:12345-0@lo:101:mount.lustre.0 Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024211.651418:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789024211.651439:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc18d433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024211.651449:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024211.651460:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4753 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024211.651466:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4753 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024211.651524:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024211.651547:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024211.653114:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371584 00000100:00100000:2.0:1789024211.653128:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371584 00000100:00100000:2.0:1789024211.653190:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789024211.653198:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+8:17122:x1875927422371584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024211.653371:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17122:x1875927422371584:12345-0@lo:501:mount.lustre.0 Request processed in 173us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024211.653378:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789024211.655248:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024211.655300:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024211.655362:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024211.655691:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024211.655771:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024211.658829:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371712 00000100:00100000:2.0:1789024211.658850:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371712 00000100:00100000:2.0:1789024211.658932:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789024211.658945:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17122:x1875927422371712:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789024211.660679:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17122:x1875927422371712:12345-0@lo:503:mount.lustre.0 Request processed in 1730us (4980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024211.660693:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789024211.660828:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422371712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024211.661278:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17161:1875927422371840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024211.661327:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024211.661363:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34733180 going to sleep for 11 seconds 00000100:00100000:2.0:1789024211.661771:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371840 00000100:00100000:2.0:1789024211.661791:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371840 00000100:00100000:2.0:1789024211.661842:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789024211.661851:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17161:x1875927422371840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024211.662798:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17161:x1875927422371840:12345-0@lo:502:llog_process_th.0 Request processed in 943us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024211.662817:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789024211.662937:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17161:1875927422371840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789024211.662971:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024211.662985:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024211.662988:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789024211.663000:0:17161:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789024211.663003:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789024211.663019:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90cc344eb380) 00000020:00000080:1.0:1789024211.663041:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789024211.663047:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789024211.663128:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789024211.665386:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb4761 00000020:00000080:1.0:1789024211.665972:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789024211.665988:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024211.665994:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024211.665996:0:17161:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789024211.665999:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024211.666007:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024211.666009:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789024211.666013:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789024211.666029:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90cc344ecd40) 00000020:00000080:1.0:1789024211.666046:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789024211.666051:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789024211.666053:0:17161:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789024211.666055:0:17161:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789024211.666062:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789024211.667768:0:17161:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb0401f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789024211.667808:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90cc344e99c0) 00000020:00000080:1.0:1789024211.667824:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789024211.667939:0:17161:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789024211.667948:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb4776 00000020:00000080:1.0:1789024211.668089:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789024211.668096:0:17161:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789024211.668101:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa736ef4b98cb477d 00080000:01000000:1.0:1789024211.668108:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789024211.668111:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb4784 00010000:00010000:3.0:1789024211.896683:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789024211.897691:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789024211.901407:0:17161:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789024211.902329:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90cb020acd40) 00000020:00000080:3.0:1789024211.902355:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789024211.906926:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789024211.906950:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb4792 00000020:00000080:3.0:1789024211.911043:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789024211.932084:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa736ef4b98cb4799 00000020:00000080:2.0:1789024211.932419:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789024211.932431:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024211.932437:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024211.932439:0:17161:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789024211.932442:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789024211.932445:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789024211.932447:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789024211.932448:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789024211.932450:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789024211.932452:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024211.932453:0:17161:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789024211.932456:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024211.932461:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024211.932463:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789024211.932467:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789024211.932501:0:17161:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789024211.932514:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024211.932517:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024211.932518:0:17161:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789024211.932521:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024211.932524:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024211.932525:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789024211.932528:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789024211.932534:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:00000080:2.0:1789024211.932571:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789024211.932588:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90cc354519c0) 00000020:00000080:2.0:1789024211.932604:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789024211.932609:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789024211.932683:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789024211.932689:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789024211.932695:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb47a7 00010000:00080000:2.0:1789024211.932733:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc192f7000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:2.0:1789024211.934409:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789024211.939746:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789024211.939765:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789024211.939817:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789024211.939846:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb47ae 00000100:00080000:0.0:1789024211.939860:0:17161:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789024211.939874:0:17161:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024211.939920:0:17161:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae2a00 x1875927422371968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789024211.939948:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789024211.940022:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024211.940026:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024211.940028:0:17161:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789024211.940031:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789024211.940034:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789024211.940036:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024211.940037:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024211.940039:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789024211.940041:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024211.940043:0:17161:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789024211.940046:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789024211.940052:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789024211.940055:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024211.940057:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789024211.940059:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789024211.940064:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789024211.940092:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789024211.940103:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024211.940117:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90cb026199c0) 00000020:00000080:0.0:1789024211.941952:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789024211.941976:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789024211.942087:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789024211.942094:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789024211.942106:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb47bc 00000100:00100000:2.0:1789024211.942966:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422371968:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789024211.943064:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789024211.943465:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3bd3d800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.118@tcp at head 00000100:00100000:3.0:1789024211.944715:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422371968 00000100:00100000:3.0:1789024211.944732:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422371968 00000100:00100000:3.0:1789024211.944795:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789024211.944805:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422371968:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789024211.944827:0:17148:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:0.0:1789024211.952763:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789024211.960770:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789024211.962625:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789024211.982462:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789024211.985432:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1789024211.989067:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422371968:12345-0@lo:38:llog_process_th.0 Request processed in 44252us (45993us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789024211.989096:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789024211.989214:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024211.989220:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789024211.989224:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422371968:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789024212.003481:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789024212.005076:0:17167:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789024212.005091:0:17167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789024212.007872:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789024212.007890:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789024212.007937:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789024212.007959:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb47c3 00000100:00080000:1.0:1789024212.007970:0:17161:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789024212.007982:0:17161:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90cc3bd3d800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024212.008033:0:17161:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab8a80 x1875927422372096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024212.008124:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372096:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789024212.008224:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422372096 offset 0 length 520: 4 00000100:00080000:0.0:1789024212.009064:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789024212.009199:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024212.009207:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024212.009209:0:17161:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789024212.009212:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789024212.009215:0:17161:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789024212.009217:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024212.009219:0:17161:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024212.009221:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789024212.009224:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024212.009225:0:17161:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789024212.009227:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789024212.009232:0:17161:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789024212.009235:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024212.009236:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789024212.009239:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789024212.009244:0:17161:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789024212.009269:0:17161:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789024212.009272:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024212.009299:0:17161:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90cb0261b380) 00000020:00000080:0.0:1789024212.009320:0:17161:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789024212.009327:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789024212.009431:0:17161:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789024212.009437:0:17161:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789024212.009444:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa736ef4b98cb47d1 00010000:00080000:0.0:1789024212.009483:0:17161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc054f2800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789024212.010353:0:17161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789024212.010428:0:17161:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789024212.010443:0:17161:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1789024212.012437:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789024212.012444:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789024212.012447:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024212.012456:0:12478:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1789024212.012462:0:12478:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789024212.012474:0:12478:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024212.012502:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab9500 x1875927422372352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789024212.012624:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422372224:0@lo:400:kworker.0 00000100:00100000:3.0:1789024212.012692:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024212.012773:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372224 00000100:00100000:3.0:1789024212.012790:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372224 00000100:00100000:3.0:1789024212.012842:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789024212.012851:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:3642:x1875927422372224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024212.012902:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:3642:x1875927422372224:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024212.012910:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789024212.012965:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422372224:0@lo:400:kworker.0 00000100:00100000:2.0:1789024212.017461:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372352:0@lo:38:kworker.0 00000100:00100000:2.0:1789024212.017572:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024212.023013:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372352 00000100:00100000:0.0:1789024212.023047:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372352 00000100:00100000:0.0:1789024212.023115:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789024212.023140:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422372352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789024212.023225:0:17149:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789024212.023371:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422372352:12345-0@lo:38:kworker.0 Request processed in 243us (5798us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789024212.023380:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789024212.024076:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024212.024088:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789024212.024093:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372352:0@lo:38:kworker.0 00000040:00080000:2.0:1789024212.026455:0:17161:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789024212.030085:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789024212.030511:0:17161:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789024212.046929:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789024212.046940:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789024212.061465:0:17161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789024212.061483:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789024212.061541:0:17161:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789024212.061566:0:17161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb47d8 00000100:00080000:2.0:1789024212.061577:0:17161:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789024212.061590:0:17161:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024212.061905:0:17161:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb03bedc00 x1875927422372480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789024212.061937:0:17161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789024212.062065:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372480:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789024212.062125:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422372480 offset 0 length 520: 4 00000020:01000000:2.0:1789024212.062297:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024212.062302:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024212.062304:0:17161:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789024212.062321:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024212.062326:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024212.062327:0:17161:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789024212.062330:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789024212.062332:0:17161:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789024212.062335:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024212.062337:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024212.062338:0:17161:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789024212.062340:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024212.062342:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024212.062344:0:17161:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789024212.062347:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789024212.062375:0:17161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17161:1875927422372608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024212.062439:0:17161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024212.062469:0:17161:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355afcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024212.063337:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372608 00000100:00100000:1.0:1789024212.063350:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372608 00000100:00100000:1.0:1789024212.063420:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789024212.063431:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17161:x1875927422372608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.063586:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17161:x1875927422372608:12345-0@lo:502:llog_process_th.0 Request processed in 156us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024212.063594:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789024212.064821:0:17161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17161:1875927422372608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789024212.064859:0:17161:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024212.064866:0:17161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024212.064868:0:17161:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789024212.064872:0:17161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789024212.066372:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789024212.066417:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789024212.066450:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4753 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.066462:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01322e00/0xa736ef4b98cb474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4753 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024212.066471:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb0401f000 from 1 10000000:01000000:1.0:1789024212.066474:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789024212.066519:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.066528:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.066539:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024212.066566:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024212.066958:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.067008:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc033dec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.067083:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372736 00000100:00100000:0.0:1789024212.067090:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372736 00000100:00100000:0.0:1789024212.067141:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024212.067194:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+9:17122:x1875927422372736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024212.067208:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024212.067234:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb47df expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.067259:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.067270:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.067294:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e400, rc 0) 00000100:00100000:0.0:1789024212.067338:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+10:17122:x1875927422372736:12345-0@lo:101:mount.lustre.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024212.067345:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789024212.067653:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024212.067669:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.067677:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024212.069101:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372864:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789024212.069872:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024212.069976:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc355afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.080305:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372864 00000100:00100000:0.0:1789024212.080325:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372864 00000100:00100000:2.0:1789024212.080530:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789024212.080542:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+10:17122:x1875927422372864:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789024212.080575:0:17136:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789024212.080584:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789024212.080709:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+10:17122:x1875927422372864:12345-0@lo:256:mount.lustre.0 Request processed in 169us (10838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024212.080718:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789024212.081379:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372864:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789024212.082374:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789024212.082394:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.082426:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024212.082436:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb0401f000 from 1 10000000:01000000:1.0:1789024212.082440:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024212.082484:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.082491:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.082501:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024212.082525:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024212.082587:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.082640:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc033de3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024212.084319:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422372992 00000100:00100000:2.0:1789024212.084331:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422372992 00000100:00100000:2.0:1789024212.084390:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789024212.084400:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+10:17122:x1875927422372992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024212.084416:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024212.084440:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb47ed expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.084470:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.084482:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 11 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.084491:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4a00, rc 0) 00000100:00100000:2.0:1789024212.084567:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422372992:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024212.084575:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789024212.086431:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422372992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024212.086460:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.086472:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024212.086612:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024212.086686:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.086796:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc033de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.092919:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373120 00000100:00100000:0.0:1789024212.092937:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373120 00000100:00100000:0.0:1789024212.093012:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789024212.093024:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422373120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024212.093254:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422373120:12345-0@lo:501:mount.lustre.0 Request processed in 231us (6566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024212.093263:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789024212.095382:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024212.095471:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024212.095551:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.095588:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc033de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.096256:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373248 00000100:00100000:0.0:1789024212.096264:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373248 00000100:00100000:0.0:1789024212.096326:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789024212.096337:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422373248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024212.096485:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422373248:12345-0@lo:503:mount.lustre.0 Request processed in 150us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024212.096492:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789024212.096850:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024212.100549:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17171:1875927422373376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.100660:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.100708:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc033dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024212.101032:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373376 00000100:00100000:2.0:1789024212.101041:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373376 00000100:00100000:2.0:1789024212.101099:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789024212.101109:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17171:x1875927422373376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024212.102323:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17171:x1875927422373376:12345-0@lo:502:llog_process_th.0 Request processed in 1204us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024212.102341:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789024212.108027:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17171:1875927422373376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789024212.108106:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024212.108135:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108139:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789024212.108515:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb0401f000 00000020:00000080:1.0:1789024212.108520:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024212.108534:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024212.108537:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108539:0:17171:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789024212.108542:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024212.108545:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108547:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789024212.108551:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb0401f000 00000020:00000080:1.0:1789024212.108553:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024212.108670:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024212.108677:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108816:0:17171:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789024212.108821:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024212.108826:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108828:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024212.108832:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb0401f000 00000020:00000080:1.0:1789024212.108851:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024212.108876:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024212.108879:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108881:0:17171:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024212.108884:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024212.108886:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.108888:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789024212.108891:0:17171:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb0401f000 00000020:00000080:1.0:1789024212.108893:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789024212.108971:0:17171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17171:1875927422373504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.109080:0:17171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.109555:0:17171:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024212.109947:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373504 00000100:00100000:3.0:1789024212.109964:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373504 00000100:00100000:3.0:1789024212.110043:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789024212.110055:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17171:x1875927422373504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789024212.110302:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17171:x1875927422373504:12345-0@lo:502:llog_process_th.0 Request processed in 248us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024212.110310:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789024212.111247:0:17171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17171:1875927422373504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789024212.111292:0:17171:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024212.111303:0:17171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024212.111305:0:17171:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789024212.111310:0:17171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789024212.112442:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789024212.112478:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024212.112747:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024212.112793:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024212.112866:0:17122:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789024212.112870:0:17122:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cb0401f000 10000000:01000000:3.0:1789024212.112873:0:17122:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cb0401f000 10000000:01000000:3.0:1789024212.112877:0:17122:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789024212.112884:0:17122:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cb0401f000 from 1 10000000:01000000:3.0:1789024212.112888:0:17122:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789024212.112932:0:17122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024212.112940:0:17122:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024212.112950:0:17122:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024212.112976:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789024212.113052:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024212.113105:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04e3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024212.115330:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373632 00000100:00100000:1.0:1789024212.115345:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373632 00000100:00100000:1.0:1789024212.115424:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789024212.115436:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17122:x1875927422373632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024212.115453:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024212.115470:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01322c00/0xa736ef4b98cb4802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb47fb expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.115502:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01322c00/0xa736ef4b98cb4802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb47fb expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.115513:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01322c00/0xa736ef4b98cb4802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb47fb expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.115539:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322c00, rc 0) 00000100:00100000:1.0:1789024212.115624:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422373632:12345-0@lo:101:mount.lustre.0 Request processed in 191us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024212.115631:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789024212.116079:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789024212.116117:0:17122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4802 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024212.116143:0:17122:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4802 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024212.116387:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024212.116468:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024212.116538:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04e3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024212.119209:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373760 00000100:00100000:1.0:1789024212.119231:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373760 00000100:00100000:1.0:1789024212.119330:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789024212.119344:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422373760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024212.119812:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422373760:12345-0@lo:501:mount.lustre.0 Request processed in 258us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024212.119822:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789024212.122036:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024212.122169:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024212.122281:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024212.122373:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04e3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024212.122505:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422373888 00000100:00100000:1.0:1789024212.122520:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422373888 00000100:00100000:1.0:1789024212.122594:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789024212.122934:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422373888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024212.123135:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422373888:12345-0@lo:503:mount.lustre.0 Request processed in 206us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024212.123143:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789024212.133510:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422373888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024212.142714:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.142826:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.142898:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141f300 going to sleep for 11 seconds 00000100:00100000:3.0:1789024212.143380:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374016 00000100:00100000:3.0:1789024212.143451:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374016 00000100:00100000:3.0:1789024212.143516:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789024212.143528:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789024212.144006:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374016:12345-0@lo:502:llog_process_th.0 Request processed in 480us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024212.144015:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789024212.151906:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374016:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789024212.152011:0:17172:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789024212.152029:0:17172:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90cc344e8000) 00000020:00000080:1.0:1789024212.152066:0:17172:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789024212.153594:0:17172:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb0401f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789024212.153852:0:17172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cb0401f000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789024212.153855:0:17172:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb0401f000 4 00010000:00080000:1.0:1789024212.153908:0:17172:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3d4b2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789024212.164366:0:17172:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789024212.168105:0:17172:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789024212.168182:0:17172:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789024212.168202:0:17172:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa736ef4b98cb4810 00000100:00080000:1.0:1789024212.168220:0:17172:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789024212.168237:0:17172:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90cc3d4b2000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024212.168295:0:17172:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fabbb80 x1875927422374144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789024212.168341:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422374144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789024212.171906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789024212.172003:0:17172:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789024212.173113:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374144 00000100:00100000:0.0:1789024212.173126:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374144 00000100:00100000:0.0:1789024212.173199:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789024212.173210:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422374144:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789024212.173322:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422374144:12345-0@lo:38:llog_process_th.0 Request processed in 113us (1579us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789024212.173344:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789024212.173691:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789024212.173700:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024212.173705:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789024212.173710:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422374144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789024212.173880:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.173951:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.173988:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.178473:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374272 00000100:00100000:0.0:1789024212.178489:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374272 00000100:00100000:0.0:1789024212.178550:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789024212.178560:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789024212.179085:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374272:12345-0@lo:502:llog_process_th.0 Request processed in 524us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024212.179095:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789024212.181004:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.181090:0:17172:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789024212.181188:0:17172:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.181237:0:17172:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024212.181575:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374400 00000100:00100000:2.0:1789024212.181583:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374400 00000100:00100000:2.0:1789024212.181639:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789024212.181650:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789024212.181812:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17172:x1875927422374400:12345-0@lo:502:llog_process_th.0 Request processed in 164us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024212.181821:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789024212.182763:0:17172:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17172:1875927422374400:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789024212.182806:0:17172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789024212.182967:0:17122:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789024212.183000:0:17122:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789024212.183024:0:17122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4802 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.183036:0:17122:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338a200/0xa736ef4b98cb47fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4802 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789024212.183096:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789024212.183098:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789024212.183100:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789024212.183102:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789024212.183103:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789024212.183104:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789024212.183106:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789024212.183107:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789024212.183109:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789024212.183111:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789024212.183115:0:17122:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789024212.183118:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789024212.183120:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789024212.183127:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789024212.183128:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789024212.183129:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789024212.183130:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789024212.183130:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789024212.183131:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789024212.183132:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789024212.183133:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789024212.183183:0:17122:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789024212.183203:0:17122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422374528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789024212.183253:0:17122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024212.183286:0:17122:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789024212.185262:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374528 00000100:00100000:0.0:1789024212.185275:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374528 00000100:00100000:0.0:1789024212.185330:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789024212.185340:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422374528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789024212.185370:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789024212.185385:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789024212.204197:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789024212.204216:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789024212.204372:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789024212.204378:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789024212.204415:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.204436:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.204444:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.204486:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.204502:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024212.204517:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422374656:0@lo:104: 00000100:00100000:1.0:1789024212.204587:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.205305:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024212.205491:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17122:x1875927422374528:12345-0@lo:253:mount.lustre.0 Request processed in 20149us (22234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024212.205501:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789024212.205579:0:17122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17122:1875927422374528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789024212.205594:0:17122:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789024212.205598:0:17122:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789024212.205600:0:17122:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789024212.207288:0:17122:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789024212.207289:0:17122:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789024212.207291:0:17122:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789024212.207293:0:17122:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789024212.207294:0:17122:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789024212.207296:0:17122:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789024212.207298:0:17122:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789024212.207299:0:17122:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789024212.207321:0:17122:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789024212.210578:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374656 00000100:00100000:2.0:1789024212.214229:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374656 00000100:00100000:2.0:1789024212.214349:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789024212.214362:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422374656:12345-0@lo:104: 00010000:00010000:2.0:1789024212.214387:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.214829:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024212.214838:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422374656:12345-0@lo:104: Request processed in 478us (10249us total) trans 0 rc 0/0 00010000:00010000:0.0:1789024212.214839:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789024212.214849:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789024212.214859:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.214935:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024212.214940:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.214951:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024212.214958:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024212.214975:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789024212.215023:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.215030:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789024212.215035:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422374656:0@lo:104: 00010000:00010000:0.0:1789024212.215066:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.215067:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.215084:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01322000/0xa736ef4b98cb47df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47e6 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024212.215238:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024212.215241:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024212.215243:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024212.215289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3643:1875927422374784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024212.215340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024212.215523:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374784 00000100:00100000:1.0:1789024212.215539:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374784 00010000:00010000:1.0:1789024212.215567:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024212.215918:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789024212.215930:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:3643:x1875927422374784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789024212.215943:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024212.215949:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.215963:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.215979:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252e400/0xa736ef4b98cb47e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb47df expref: 12 pid: 17138 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.215993:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216002:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789024212.216019:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641837s 00010000:00010000:1.0:1789024212.216024:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216031:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216038:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216482:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216492:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024212.216496:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.216504:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.221586:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024212.221782:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.221862:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.221875:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb4817 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024212.221899:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024212.222044:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:3643:x1875927422374784:12345-0@lo:103:ldlm_bl.0 Request processed in 6113us (6700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024212.222056:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789024212.222355:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3643:1875927422374784:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789024212.240294:0:17122:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789024212.241545:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789024212.245187:0:17183:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789024212.245210:0:17183:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789024212.260488:0:17184:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789024212.260788:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1789024212.267573:0:17185:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90cb03befb80 x1875927422374912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024212.267594:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00000040:01000000:0.0:1789024212.267930:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789024212.267982:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789024212.268437:0:17122:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789024212.268584:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789024212.268629:0:17122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789024212.269768:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789024212.270656:0:17122:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789024212.270700:0:17122:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789024212.276968:0:17122:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000040:00080000:3.0:1789024212.280082:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789024212.283118:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789024212.283231:0:17184:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1789024212.286650:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789024212.313096:0:17122:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789024212.313253:0:17122:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9dfe01c13988 00100000:10000000:0.0:1789024212.313265:0:17122:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789024212.316847:0:17122:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789024212.316876:0:17122:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789024212.316904:0:17122:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789024212.316927:0:17122:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789024212.318054:0:17122:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789024212.318382:0:17122:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789024212.492448:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789024213.262640:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789024213.324880:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 10000000:01000000:2.0:1789024213.324913:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789024213.324918:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb0401f000 from 7 10000000:01000000:2.0:1789024213.324922:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789024213.324973:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024213.324987:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024213.325001:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024213.325032:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422375040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024213.325105:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024213.325175:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024213.327866:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375040 00000100:00100000:0.0:1789024213.327888:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375040 00000100:00100000:0.0:1789024213.327986:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789024213.328001:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+11:17140:x1875927422375040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789024213.328029:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024213.328058:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb481e expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024213.328096:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024213.328110:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024213.328119:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f800, rc 0) 00000100:00100000:0.0:1789024213.328247:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17140:x1875927422375040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024213.328255:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789024213.328780:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422375040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024213.328803:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024213.328816:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024213.328903:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422375168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789024213.328962:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024213.328998:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024213.329921:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375168 00000100:00100000:0.0:1789024213.329930:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375168 00000100:00100000:0.0:1789024213.329984:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789024213.329994:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17140:x1875927422375168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789024213.330024:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789024213.330042:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789024213.330044:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789024213.330180:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17140:x1875927422375168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 187us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024213.330188:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789024213.330306:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422375168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789024213.330358:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789024213.330367:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024213.330379:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024213.519084:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789024214.286979:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789024214.348266:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024214.541280:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024215.372269:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:1.0:1789024215.564306:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024216.399279:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024216.589458:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024217.422067:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00000100:00100000:3.0:1789024217.484363:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422375296:0@lo:400:kworker.0 00000100:00100000:3.0:1789024217.484476:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789024217.484738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789024217.484744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789024217.484747:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789024217.484753:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:0.0:1789024217.484759:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789024217.484772:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024217.484800:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae0700 x1875927422375424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789024217.484817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789024217.484821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789024217.484824:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789024217.484827:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789024217.484830:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789024217.484833:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789024217.484843:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789024217.484850:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90cc3d4b2000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024217.484864:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae1500 x1875927422375552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789024217.484894:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375424:0@lo:38:kworker.0 00000100:00100000:0.0:1789024217.484935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024217.484972:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422375552:0@lo:38:kworker.0 00000100:00100000:0.0:1789024217.485002:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024217.485244:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375424 00000100:00100000:0.0:1789024217.485257:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375424 00000100:00100000:0.0:1789024217.485305:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789024217.485313:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422375424:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789024217.485334:0:17149:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789024217.488420:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375552 00000100:00100000:1.0:1789024217.488437:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375552 00000100:00100000:1.0:1789024217.488482:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789024217.488491:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422375552:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789024217.488527:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:1.0:1789024217.488572:0:17145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa736ef4b98cb482c 00000004:00100000:1.0:1789024217.488596:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789024217.489880:0:17145:0:(import.c:65:import_set_state_nolock()) ffff90cc344f4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024217.489988:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875927422375552:12345-0@lo:38:kworker.0 Request processed in 1495us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024217.489998:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789024217.490063:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90cc3fae1500 x1875927422375552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789024217.490161:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789024217.490171:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789024217.490176:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789024217.490179:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3d4b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789024217.490186:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875927422375552:0@lo:38:kworker.0 00000100:00100000:3.0:1789024217.490781:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375296 00000100:00100000:3.0:1789024217.490791:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375296 00000100:00100000:3.0:1789024217.490839:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789024217.490847:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:3644:x1875927422375296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024217.490905:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:3644:x1875927422375296:12345-0@lo:400:kworker.0 Request processed in 59us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024217.490913:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789024217.490962:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422375296:0@lo:400:kworker.0 00000100:00100000:0.0:1789024217.504974:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422375424:12345-0@lo:38:kworker.0 Request processed in 19640us (20018us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789024217.504995:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789024217.505478:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024217.505485:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789024217.505490:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375424:0@lo:38:kworker.0 00010000:00010000:1.0:1789024217.614342:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789024217.980993:0:17428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789024218.444289:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024218.641871:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789024219.221347:0:17480:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789024219.221575:0:17480:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789024219.469695:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:1.0:1789024219.660468:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789024220.218690:0:17530:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024220.218877:0:17530:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789024220.497646:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024220.684418:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024221.521310:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:1.0:1789024221.708352:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024222.540250:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00000100:00100000:0.0:1789024222.611738:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024212/real 1789024212] req@ffff90cb03bedc00 x1875927422372480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024222.611781:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cb03bedc00 x1875927422372480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024222.611817:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024212/real 1789024212] req@ffff90cc3fab8a80 x1875927422372096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024222.611830:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3fab8a80 x1875927422372096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789024222.611853:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024222.617317:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789024222.617327:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789024222.617332:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024222.617343:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1789024222.617351:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789024222.617366:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024222.617417:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fabb100 x1875927422375808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024222.617433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024222.617438:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024222.617441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024222.617445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789024222.617447:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024222.617451:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1789024222.617454:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789024222.617459:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024222.617471:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fabb480 x1875927422375936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789024222.617531:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422375680:0@lo:400:kworker.0 00000100:00100000:1.0:1789024222.617629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024222.617710:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024222.617716:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422376064:0@lo:400:kworker.0 00000100:00100000:1.0:1789024222.617747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024222.617794:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375680 00000100:00100000:1.0:1789024222.617805:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375680 00000100:00100000:1.0:1789024222.617870:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789024222.617881:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:3641:x1875927422375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024222.617946:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:3641:x1875927422375680:12345-0@lo:400:kworker.0 Request processed in 67us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024222.617955:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789024222.618012:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376064 00000100:00100000:1.0:1789024222.618024:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376064 00000100:00100000:1.0:1789024222.618072:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789024222.618079:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422376064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024222.618114:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422376064:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024222.618120:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789024222.618193:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90cc3faba300 x1875927422376064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024222.618209:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422376064:0@lo:400:kworker.0 00000100:00100000:1.0:1789024222.618219:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422375680:0@lo:400:kworker.0 00000100:00080000:0.0:1789024222.622121:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789024222.622139:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789024222.622197:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024222.624700:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024222.624712:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789024222.624718:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024222.624729:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1789024222.624737:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789024222.624755:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90cc3bd3d800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024222.624808:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fabbb80 x1875927422376192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789024222.625318:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789024222.625327:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422372096:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789024222.625378:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375808:0@lo:38:kworker.0 00000100:00100000:0.0:1789024222.625475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024222.625526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375936:0@lo:8:kworker.0 00000400:00000100:0.0:1789024222.625555:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422375936 offset 0 length 520: 4 00000100:00100000:0.0:1789024222.625582:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422376192:0@lo:8:kworker.0 00000400:00000100:0.0:1789024222.625601:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422376192 offset 0 length 520: 4 00000100:00100000:0.0:1789024222.625654:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422375808 00000100:00100000:0.0:1789024222.625665:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422375808 00000100:00100000:0.0:1789024222.625722:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789024222.625731:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422375808:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789024222.625754:0:17148:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789024222.664609:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422375808:12345-0@lo:38:kworker.0 Request processed in 38859us (39115us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789024222.664640:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789024222.664758:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024222.664766:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789024222.664771:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375808:0@lo:38:kworker.0 00010000:00010000:0.0:1789024222.732582:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024223.568006:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:2.0:1789024223.757141:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024224.524778:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024224.596729:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024224.781264:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024225.613083:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:2.0:1789024225.806343:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024226.636333:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024226.828693:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789024226.911667:0:17875:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789024226.911673:0:17875:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789024226.911674:0:17875:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789024226.911836:0:17875:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cb03356800 00000020:01000004:3.0:1789024226.911852:0:17875:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789024226.911864:0:17875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789024226.911877:0:17875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90cb020a99c0) 00000020:00000080:3.0:1789024226.911892:0:17875:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789024227.016850:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789024227.017079:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789024227.028607:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789024227.029114:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789024227.029745:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.030056:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.030317:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.030774:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789024227.030997:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.031208:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.031510:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789024227.032008:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789024227.032215:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789024227.032449:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789024227.036342:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.036778:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.037225:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.037789:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.038382:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.039543:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.039822:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.040165:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.040391:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.040829:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.041097:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.041360:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.041630:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.041809:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.041977:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.042280:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.042529:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.042894:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.043077:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.043312:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789024227.043544:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789024227.053950:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789024227.055424:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.055815:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789024227.056041:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.056267:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.056529:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789024227.056748:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.056948:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.057187:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789024227.057422:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789024227.057612:0:17875:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00080000:01000000:1.0:1789024227.061272:0:17875:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789024227.062116:0:17875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789024227.062129:0:17875:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789024227.062143:0:17875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb483a 00000020:01000004:1.0:1789024227.062177:0:17875:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789024227.062198:0:17875:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789024227.062202:0:17875:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789024227.062208:0:17875:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789024227.062249:0:17875:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789024227.062253:0:17875:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789024227.070532:0:17875:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789024227.070571:0:17875:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.118@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789024227.070575:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789024227.070577:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789024227.070578:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024227.070580:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024227.070581:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024227.070582:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024227.070583:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024227.070585:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024227.070586:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789024227.070590:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789024227.070592:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789024227.070594:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789024227.070595:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024227.070596:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024227.070597:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024227.070603:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024227.070604:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024227.070604:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024227.070605:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789024227.070631:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789024227.070802:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376320:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789024227.070873:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.070973:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc198be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.071065:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376320 00000100:00100000:0.0:1789024227.071075:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376320 00000100:00100000:0.0:1789024227.071178:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789024227.071189:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17875:x1875927422376320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789024227.071219:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789024227.071222:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789024227.071230:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789024227.071508:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17875:x1875927422376320:12345-0@lo:253:mount.lustre.0 Request processed in 320us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.071516:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789024227.071582:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789024227.071594:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789024227.071597:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789024227.071599:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789024227.071600:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789024227.071601:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789024227.071603:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789024227.071604:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789024227.071614:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789024227.071615:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789024227.071617:0:17875:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789024227.071642:0:17875:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cb03356800 from lustre-MDT0001 10000000:01000000:2.0:1789024227.071672:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789024227.071675:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789024227.071682:0:17875:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cb020a8000 local copy 00010000:00010000:2.0:1789024227.071691:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.071772:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024227.071801:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.071828:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.071878:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376448 00000100:00100000:1.0:1789024227.071883:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376448 00000100:00100000:1.0:1789024227.071914:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789024227.071923:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17875:x1875927422376448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024227.072092:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17875:x1875927422376448:12345-0@lo:501:mount.lustre.0 Request processed in 170us (289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789024227.072099:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789024227.072493:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376448:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789024227.072512:0:17875:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789024227.072530:0:17875:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789024227.072536:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.072545:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024227.072570:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cb03356800 10000000:01000000:2.0:1789024227.072574:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789024227.072578:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90cb020a8000 10000000:01000000:2.0:1789024227.072581:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789024227.072584:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90cb020a8000 from 1 10000000:01000000:2.0:1789024227.072587:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789024227.072607:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.072626:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.072645:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.072657:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789024227.072680:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.072707:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.072761:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376576 00000100:00100000:0.0:1789024227.072766:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376576 00000100:00100000:0.0:1789024227.072824:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789024227.072831:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+12:17875:x1875927422376576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024227.072840:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024227.072852:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252fc00/0xa736ef4b98cb4848 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4841 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.072872:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252fc00/0xa736ef4b98cb4848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4841 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.072882:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252fc00/0xa736ef4b98cb4848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4841 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.072891:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252fc00, rc 0) 00000100:00100000:0.0:1789024227.072928:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+13:17875:x1875927422376576:12345-0@lo:101:mount.lustre.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.072934:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789024227.072961:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.072976:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4848 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.073104:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4848 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.073125:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789024227.073163:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4848 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.073171:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c4400/0xa736ef4b98cb4841 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4848 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.073179:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90cb03356800 10000000:01000000:1.0:1789024227.073189:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789024227.073193:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90cb03356800 from 1 10000000:01000000:1.0:1789024227.073195:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789024227.073211:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.073219:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.073226:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024227.073239:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024227.073266:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.075316:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789024227.084293:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376704 00000100:00100000:2.0:1789024227.084311:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376704 00000100:00100000:2.0:1789024227.085284:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024227.085303:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+13:17875:x1875927422376704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024227.085323:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024227.085345:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c4600/0xa736ef4b98cb4856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb484f expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.085392:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c4600/0xa736ef4b98cb4856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb484f expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.085404:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c4600/0xa736ef4b98cb4856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb484f expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.085412:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4600, rc 0) 00000100:00100000:2.0:1789024227.085499:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+14:17875:x1875927422376704:12345-0@lo:101:mount.lustre.0 Request processed in 204us (12231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024227.085506:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789024227.085875:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.085895:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4856 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.085906:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4856 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.085935:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789024227.086013:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4856 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.086021:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323a00/0xa736ef4b98cb484f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4856 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.086029:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789024227.086042:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789024227.086047:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90cb03356800 10000000:01000000:1.0:1789024227.086053:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789024227.086057:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789024227.086060:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789024227.086095:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.086102:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.086109:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024227.086130:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024227.086192:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.086225:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.089578:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376832 00000100:00100000:0.0:1789024227.089596:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376832 00000100:00100000:0.0:1789024227.089662:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789024227.089672:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+14:17875:x1875927422376832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024227.089688:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024227.089707:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252e800/0xa736ef4b98cb4864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb485d expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.089735:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252e800/0xa736ef4b98cb4864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb485d expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.089747:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252e800/0xa736ef4b98cb4864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb485d expref: 15 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.089756:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e800, rc 0) 00000100:00100000:0.0:1789024227.091632:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422376832:12345-0@lo:101:mount.lustre.0 Request processed in 1951us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.091655:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789024227.093815:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.093845:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4864 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.093859:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4864 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024227.096470:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789024227.097544:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789024227.109667:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789024227.111253:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789024227.111300:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789024227.111314:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789024227.111340:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789024227.111352:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789024227.111363:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789024227.111375:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789024227.111389:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789024227.111403:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789024227.111417:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789024227.111429:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789024227.111443:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789024227.111457:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789024227.111470:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789024227.111483:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789024227.111497:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789024227.111509:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789024227.111521:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789024227.111536:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789024227.111549:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789024227.111563:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789024227.111577:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789024227.111608:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789024227.111614:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789024227.114252:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024227.114338:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.114384:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043780 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.114403:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422376960 00000100:00100000:0.0:1789024227.114413:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422376960 00000100:00100000:0.0:1789024227.114465:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789024227.114475:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422376960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024227.114666:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422376960:12345-0@lo:501:mount.lustre.0 Request processed in 191us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.114675:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789024227.114715:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422376960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024227.114764:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789024227.114807:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.114834:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024227.114883:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377088 00000100:00100000:3.0:1789024227.114888:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377088 00000100:00100000:3.0:1789024227.114920:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789024227.114927:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024227.115624:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377088:12345-0@lo:503:mount.lustre.0 Request processed in 694us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.115632:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789024227.115765:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377088:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789024227.116348:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789024227.116433:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024227.116479:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.116504:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.117502:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377216 00000100:00100000:1.0:1789024227.117513:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377216 00000100:00100000:1.0:1789024227.117606:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789024227.117617:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024227.122199:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377216:12345-0@lo:502:mount.lustre.0 Request processed in 4573us (5709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.122216:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789024227.122379:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024227.122653:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789024227.122685:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789024227.122701:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789024227.122715:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789024227.122743:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789024227.122759:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789024227.122773:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789024227.122787:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789024227.122799:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789024227.122813:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789024227.122828:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789024227.122841:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789024227.122854:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789024227.122867:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789024227.122881:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789024227.122894:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789024227.122907:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789024227.122935:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789024227.122964:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789024227.122976:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789024227.122989:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789024227.123003:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789024227.123015:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789024227.123029:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789024227.123043:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789024227.123060:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789024227.123071:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789024227.123085:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789024227.123097:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789024227.123110:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789024227.123123:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789024227.123135:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789024227.123175:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789024227.123195:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789024227.123208:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789024227.123221:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789024227.123232:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789024227.123246:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789024227.123259:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789024227.123272:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789024227.123286:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789024227.123299:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789024227.123312:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789024227.123324:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789024227.123362:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024227.123418:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.131337:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1072af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789024227.139309:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377344 00000100:00100000:3.0:1789024227.139328:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377344 00000100:00100000:1.0:1789024227.139496:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789024227.139510:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024227.139719:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422377344:12345-0@lo:502:mount.lustre.0 Request processed in 212us (16299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.139727:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789024227.139893:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422377344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024227.139990:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789024227.140016:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789024227.141673:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024227.141687:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.141690:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789024227.141696:0:17879:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789024227.141699:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024227.141714:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90cb0261cd40) 00000020:00000080:0.0:1789024227.141740:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789024227.141747:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789024227.141834:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789024227.141841:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb4872 00000020:00000080:0.0:1789024227.142184:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789024227.142190:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024227.142195:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.142197:0:17879:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789024227.142199:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024227.142203:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.142205:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789024227.142208:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024227.142217:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90cc30c33380) 00000020:00000080:0.0:1789024227.142229:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789024227.142232:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789024227.142234:0:17879:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789024227.142237:0:17879:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789024227.142243:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789024227.142315:0:17879:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb03356800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789024227.142329:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90cc30c30000) 00000020:00000080:0.0:1789024227.142337:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789024227.143436:0:17879:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789024227.143450:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb4887 00000020:00000080:0.0:1789024227.143582:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789024227.143590:0:17879:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789024227.143594:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa736ef4b98cb488e 00080000:01000000:0.0:1789024227.143601:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789024227.143610:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb4895 00010000:00010000:2.0:1789024227.341074:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789024227.342504:0:17879:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789024227.349921:0:17879:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789024227.352455:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789024227.352474:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024227.352485:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.352488:0:17879:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789024227.352491:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024227.352502:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.352504:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789024227.352509:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789024227.352517:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:00000080:0.0:1789024227.352555:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024227.352577:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90cc30c34d40) 00000020:00000080:0.0:1789024227.352607:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789024227.352613:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789024227.352745:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789024227.352754:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789024227.352762:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb48a3 00010000:00080000:0.0:1789024227.352804:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc0531d800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789024227.356896:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789024227.358411:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789024227.358429:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789024227.358470:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789024227.358493:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb48aa 00000100:00080000:1.0:1789024227.358503:0:17879:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789024227.358516:0:17879:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90cc0531d800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024227.358557:0:17879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab9880 x1875927422377472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024227.358585:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789024227.358615:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789024227.358620:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789024227.358622:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024227.358626:0:12478:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1789024227.358629:0:12478:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789024227.358645:0:12478:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024227.358658:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fabb800 x1875927422377600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024227.358668:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.358672:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024227.358675:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.358686:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024227.358739:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422377728:0@lo:400:kworker.0 00000100:00100000:1.0:1789024227.358809:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.358871:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377728 00000100:00100000:1.0:1789024227.358877:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377728 00000100:00100000:1.0:1789024227.358918:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789024227.358926:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024227.358984:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422377728:12345-0@lo:400:kworker.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.358991:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789024227.359027:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90cc3fab8000 x1875927422377728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024227.359040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422377728:0@lo:400:kworker.0 00000020:01000000:1.0:1789024227.359088:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.359092:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359094:0:17879:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789024227.359097:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789024227.359100:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789024227.359101:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789024227.359103:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789024227.359104:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789024227.359107:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359108:0:17879:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789024227.359110:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024227.359114:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359116:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789024227.359120:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789024227.359179:0:17879:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789024227.359191:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.359199:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359201:0:17879:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789024227.359204:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789024227.359206:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789024227.359207:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789024227.359209:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789024227.359211:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789024227.359213:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359215:0:17879:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789024227.359217:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789024227.359221:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789024227.359224:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.359226:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789024227.359229:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789024227.359232:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:1.0:1789024227.359254:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789024227.359257:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789024227.359272:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90cc31213380) 00000020:00000080:1.0:1789024227.359285:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789024227.359289:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789024227.359349:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789024227.359355:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789024227.359360:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb48b8 00010000:00080000:1.0:1789024227.359391:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3538e800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789024227.359590:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789024227.359992:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422377472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789024227.360063:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.360106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422377600:0@lo:38:kworker.0 00000100:00100000:0.0:1789024227.360129:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.360907:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377472 00000100:00100000:1.0:1789024227.360916:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377472 00000100:00100000:1.0:1789024227.360941:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377600 00000100:00100000:1.0:1789024227.360944:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377600 00000100:00100000:1.0:1789024227.360955:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789024227.360962:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422377472:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789024227.361036:0:17149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789024227.361083:0:17149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb48bf 00000004:00100000:1.0:1789024227.361098:0:17149:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789024227.361104:0:17149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1789024227.361979:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789024227.362268:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789024227.363845:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789024227.364027:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789024227.364171:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789024227.364726:0:17884:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789024227.364732:0:17884:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1789024227.373656:0:17149:0:(import.c:65:import_set_state_nolock()) ffff90cc3455f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024227.373839:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422377472:12345-0@lo:38:llog_process_th.0 Request processed in 12874us (13774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.373852:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789024227.373881:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789024227.373887:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422377600:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789024227.373933:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875927422377600:12345-0@lo:38:kworker.0 Request processed in 45us (13803us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789024227.373940:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1789024227.374885:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789024227.374906:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789024227.374957:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789024227.374998:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb48c6 00000100:00080000:0.0:1789024227.375009:0:17879:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789024227.375020:0:17879:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90cc3538e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024227.375057:0:17879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae0700 x1875927422377856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789024227.375092:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789024227.375346:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024227.375350:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.375352:0:17879:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789024227.375355:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789024227.375358:0:17879:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789024227.375359:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024227.375361:0:17879:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024227.375362:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789024227.375365:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.375376:0:17879:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789024227.375379:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789024227.375383:0:17879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789024227.375387:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024227.375388:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789024227.375391:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789024227.375395:0:17879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.118@tcp to nid 0x20000c0a8ca76 (192.168.202.118@tcp) 00000020:01000000:0.0:1789024227.375421:0:17879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789024227.375424:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789024227.375438:0:17879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90cc30c319c0) 00000020:00000080:0.0:1789024227.375451:0:17879:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789024227.375456:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789024227.375534:0:17879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789024227.375542:0:17879:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789024227.375548:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa736ef4b98cb48d4 00010000:00080000:0.0:1789024227.375583:0:17879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc3538c000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789024227.375807:0:17879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789024227.375882:0:17879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789024227.375898:0:17879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1789024227.376641:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024227.376653:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789024227.376661:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789024227.376667:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789024227.376671:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc0531d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789024227.376681:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422377472:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789024227.376705:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024227.376709:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024227.376713:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789024227.376716:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422377600:0@lo:38:kworker.0 00000100:00100000:3.0:1789024227.376744:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422377856:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789024227.376781:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422377856 offset 0 length 520: 4 00000100:00100000:0.0:1789024227.378784:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789024227.378804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422377984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024227.378881:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.378928:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422377984 00000100:00100000:0.0:1789024227.378934:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422377984 00000100:00100000:0.0:1789024227.378974:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024227.378993:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875927422377984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024227.379033:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789024227.379075:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875927422377984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.379082:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024227.379119:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422377984:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789024227.380575:0:17879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789024227.382081:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789024227.382272:0:17879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:1.0:1789024227.383276:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.383283:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024227.383286:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.383288:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789024227.383603:0:17886:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789024227.383609:0:17886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789024227.388551:0:17879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789024227.388568:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789024227.388615:0:17879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789024227.388710:0:17879:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb48db 00000100:00080000:3.0:1789024227.388721:0:17879:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789024227.388733:0:17879:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024227.388787:0:17879:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9ee680 x1875927422378112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789024227.388859:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422378112:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789024227.388909:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422378112 offset 0 length 520: 4 00000100:00080000:3.0:1789024227.388964:0:17879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789024227.389026:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024227.389030:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024227.389032:0:17879:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789024227.389036:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789024227.389039:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024227.389041:0:17879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789024227.389044:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789024227.389046:0:17879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789024227.389049:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024227.389051:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024227.389052:0:17879:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789024227.389065:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789024227.389069:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024227.389070:0:17879:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789024227.389074:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789024227.389106:0:17879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024227.389108:0:17879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024227.389110:0:17879:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789024227.389113:0:17879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1789024227.389351:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789024227.389385:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00080000:1.0:1789024227.389457:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.389462:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024227.389465:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.389468:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789024227.389502:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4864 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.389515:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323400/0xa736ef4b98cb485d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4864 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024227.389523:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb03356800 from 1 10000000:01000000:3.0:1789024227.389526:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789024227.389552:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.389560:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.389571:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024227.389587:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789024227.389624:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.389672:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc0751ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.389786:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378240 00000100:00100000:1.0:1789024227.389792:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378240 00000100:00100000:1.0:1789024227.389845:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789024227.389854:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+15:17875:x1875927422378240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.389867:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024227.389880:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb48e2 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.389902:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.389913:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 16 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.389921:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322a00, rc 0) 00000100:00100000:1.0:1789024227.389956:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17875:x1875927422378240:12345-0@lo:101:mount.lustre.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.389961:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789024227.390016:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.390028:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.390037:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024227.390522:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378368:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789024227.390558:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.390573:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043780 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.390588:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378368 00000100:00100000:1.0:1789024227.390591:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378368 00000100:00100000:1.0:1789024227.390673:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789024227.390679:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17875:x1875927422378368:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789024227.390691:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789024227.390705:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789024227.390708:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789024227.390769:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17875:x1875927422378368:12345-0@lo:256:mount.lustre.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.390775:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789024227.390803:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378368:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789024227.391320:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789024227.391816:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.391827:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.391835:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb03356800 from 1 10000000:01000000:1.0:1789024227.391838:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024227.391866:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.391873:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.391882:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024227.391899:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024227.391938:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.391982:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043780 going to sleep for 11 seconds 00000100:00100000:3.0:1789024227.392024:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378496 00000100:00100000:3.0:1789024227.392036:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378496 00000100:00100000:3.0:1789024227.392076:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789024227.392083:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17875:x1875927422378496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789024227.392093:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024227.392104:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb48f0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.392126:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.392136:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.392176:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a600, rc 0) 00000100:00100000:3.0:1789024227.392227:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378496:12345-0@lo:101:mount.lustre.0 Request processed in 145us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.392233:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024227.392407:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024227.392420:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.392429:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024227.392574:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789024227.392601:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024227.392626:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.392665:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789024227.392756:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378624 00000100:00100000:3.0:1789024227.392761:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378624 00000100:00100000:3.0:1789024227.392791:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789024227.392798:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024227.392878:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378624:12345-0@lo:501:mount.lustre.0 Request processed in 80us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.392884:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024227.392963:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024227.392983:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024227.393022:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.393043:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.393083:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378752 00000100:00100000:1.0:1789024227.393087:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378752 00000100:00100000:1.0:1789024227.393117:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789024227.393124:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024227.393233:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378752:12345-0@lo:503:mount.lustre.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.393241:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789024227.393368:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789024227.393725:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789024227.393792:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024227.393824:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.393854:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203000 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.393959:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422378880 00000100:00100000:1.0:1789024227.393964:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422378880 00000100:00100000:1.0:1789024227.393997:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789024227.394003:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024227.394069:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422378880:12345-0@lo:502:mount.lustre.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.394076:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789024227.394108:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422378880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789024227.394303:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789024227.394325:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789024227.394337:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789024227.394348:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789024227.394359:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789024227.394370:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789024227.394382:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789024227.394393:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789024227.394404:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789024227.394425:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789024227.394437:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789024227.394455:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024227.394490:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.394504:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043240 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.394517:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379008 00000100:00100000:1.0:1789024227.394520:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379008 00000100:00100000:1.0:1789024227.394536:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789024227.394541:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422379008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024227.394599:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422379008:12345-0@lo:502:mount.lustre.0 Request processed in 57us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.394605:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789024227.394653:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789024227.394683:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789024227.394689:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789024227.394901:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024227.394909:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.394912:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789024227.394918:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb03356800 00000020:00000080:1.0:1789024227.394920:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024227.394927:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.394929:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.394931:0:17888:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789024227.394934:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024227.394936:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.394937:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789024227.394940:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cb03356800 00000020:00000080:1.0:1789024227.394942:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024227.394994:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.394997:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.394998:0:17888:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789024227.395000:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024227.395002:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.395008:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024227.395012:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb03356800 00000020:00000080:1.0:1789024227.395014:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024227.395029:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.395031:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.395033:0:17888:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024227.395035:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024227.395037:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.395038:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789024227.395041:0:17888:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cb03356800 00000020:00000080:1.0:1789024227.395043:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024227.395060:0:17888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024227.395062:0:17888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024227.395063:0:17888:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789024227.395065:0:17888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789024227.395111:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789024227.395127:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789024227.404838:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.404858:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024227.404944:0:17875:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789024227.404947:0:17875:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cb03356800 10000000:01000000:1.0:1789024227.404951:0:17875:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cb03356800 10000000:01000000:1.0:1789024227.404955:0:17875:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789024227.404962:0:17875:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cb03356800 from 1 10000000:01000000:1.0:1789024227.404965:0:17875:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789024227.404999:0:17875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405024:0:17875:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405034:0:17875:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024227.405055:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024227.405120:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.405176:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043780 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.405339:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379136 00000100:00100000:1.0:1789024227.405347:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379136 00000100:00100000:1.0:1789024227.405395:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789024227.405405:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17875:x1875927422379136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.405420:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024227.405432:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01323c00/0xa736ef4b98cb4905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb48fe expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405455:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01323c00/0xa736ef4b98cb4905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb48fe expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405465:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01323c00/0xa736ef4b98cb4905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb48fe expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405473:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323c00, rc 0) 00000100:00100000:1.0:1789024227.405511:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379136:12345-0@lo:101:mount.lustre.0 Request processed in 107us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.405518:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789024227.405570:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024227.405582:0:17875:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4905 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024227.405590:0:17875:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4905 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024227.417687:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789024227.417940:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789024227.418160:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789024227.418185:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789024227.418198:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789024227.418282:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789024227.418296:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789024227.418308:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789024227.418319:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789024227.418330:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789024227.418341:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789024227.418352:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789024227.418365:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789024227.418378:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789024227.418391:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789024227.418419:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789024227.418522:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789024227.418538:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789024227.418549:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789024227.418560:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789024227.418571:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789024227.418582:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789024227.418593:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789024227.418611:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789024227.418623:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789024227.418646:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789024227.418660:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789024227.418671:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789024227.418686:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789024227.418697:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789024227.418714:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789024227.418718:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789024227.418788:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024227.418848:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.418883:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379264 00000100:00100000:0.0:1789024227.418889:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379264 00000100:00100000:0.0:1789024227.421802:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789024227.421822:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379264:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024227.421981:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379264:12345-0@lo:501:mount.lustre.0 Request processed in 167us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.421988:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789024227.423464:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789024227.423503:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024227.423557:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024227.423619:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024227.423698:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.425305:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379392 00000100:00100000:0.0:1789024227.425318:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379392 00000100:00100000:0.0:1789024227.425391:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789024227.425402:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379392:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024227.425537:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379392:12345-0@lo:503:mount.lustre.0 Request processed in 136us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.425544:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789024227.425614:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789024227.426067:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789024227.426166:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024227.427491:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024227.428493:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1924a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789024227.433000:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379520 00000100:00100000:2.0:1789024227.433019:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379520 00000100:00100000:3.0:1789024227.433468:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789024227.433480:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024227.433665:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379520:12345-0@lo:502:mount.lustre.0 Request processed in 187us (7459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.433681:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789024227.433765:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024227.434063:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789024227.434089:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1789024227.434101:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1789024227.434112:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1789024227.434123:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1789024227.434134:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1789024227.434174:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1789024227.434188:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1789024227.434198:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1789024227.434208:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1789024227.434218:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1789024227.434229:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1789024227.434241:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1789024227.434251:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1789024227.434261:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1789024227.434271:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1789024227.434281:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1789024227.434291:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1789024227.434301:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1789024227.434312:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1789024227.434323:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1789024227.434334:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1789024227.434345:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1789024227.434356:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1789024227.434369:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1789024227.434379:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1789024227.434393:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1789024227.434404:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1789024227.434422:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1789024227.434432:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1789024227.434442:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1789024227.434451:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1789024227.434461:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1789024227.434471:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1789024227.434481:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1789024227.434492:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1789024227.434502:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1789024227.434524:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1789024227.434535:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1789024227.434545:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1789024227.434555:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1789024227.434565:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1789024227.434574:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1789024227.434584:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1789024227.434594:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1789024227.434604:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1789024227.434614:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1789024227.434624:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1789024227.434681:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024227.434728:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.434759:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616000 going to sleep for 11 seconds 00000100:00100000:2.0:1789024227.434916:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379648 00000100:00100000:2.0:1789024227.434923:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379648 00000100:00100000:2.0:1789024227.434964:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789024227.434972:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024227.435057:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379648:12345-0@lo:502:mount.lustre.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024227.435064:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789024227.435300:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024227.435425:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1789024227.435444:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1789024227.435461:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024227.435490:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.435772:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616000 going to sleep for 11 seconds 00000100:00100000:2.0:1789024227.436914:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379776 00000100:00100000:2.0:1789024227.436924:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379776 00000100:00100000:3.0:1789024227.437023:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789024227.437038:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024227.437187:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422379776:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.437194:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789024227.437257:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422379776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024227.437316:0:17875:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1789024227.437328:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789024227.439409:0:17895:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789024227.439430:0:17895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90cc339999c0) 00000020:00000080:0.0:1789024227.439456:0:17895:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789024227.439554:0:17895:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cb03356800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789024227.439559:0:17895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cb03356800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789024227.439561:0:17895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cb03356800 3 00010000:00080000:0.0:1789024227.439592:0:17895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc41599800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.118@tcp at head 00010000:00010000:0.0:1789024227.444577:0:17895:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789024227.444810:0:17895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789024227.444865:0:17895:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789024227.444881:0:17895:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa736ef4b98cb4913 00000100:00080000:0.0:1789024227.444893:0:17895:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789024227.444908:0:17895:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90cc41599800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024227.444945:0:17895:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fae0000 x1875927422379904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789024227.444980:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422379904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789024227.445044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789024227.445104:0:17895:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789024227.445295:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422379904 00000100:00100000:1.0:1789024227.445303:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422379904 00000100:00100000:1.0:1789024227.445342:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789024227.445350:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875927422379904:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789024227.445373:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789024227.445409:0:17145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa736ef4b98cb491a 00000004:00100000:1.0:1789024227.445426:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789024227.445458:0:17145:0:(import.c:65:import_set_state_nolock()) ffff90cb03398000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024227.445516:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875927422379904:12345-0@lo:38:llog_process_th.0 Request processed in 166us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.445524:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789024227.445551:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.445556:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024227.445558:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024227.445574:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1789024227.445621:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90cc3fae0000 x1875927422379904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024227.445641:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789024227.445650:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789024227.445657:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789024227.445662:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789024227.445665:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc41599800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789024227.445671:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875927422379904:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789024227.448346:0:17895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1789024227.448398:0:17875:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789024227.448443:0:17875:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789024227.448462:0:17875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4905 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.448474:0:17875:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01322600/0xa736ef4b98cb48fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4905 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789024227.448551:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789024227.448553:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789024227.448555:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789024227.448556:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789024227.448557:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789024227.448559:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789024227.448560:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789024227.448563:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789024227.448564:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789024227.448569:0:17875:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789024227.448571:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789024227.448572:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789024227.448574:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789024227.448575:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789024227.448575:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789024227.448576:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789024227.448582:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789024227.448583:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789024227.448584:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789024227.448611:0:17875:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789024227.448644:0:17875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422380032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789024227.448715:0:17875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.448761:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380032 00000100:00100000:3.0:1789024227.448769:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380032 00000100:00100000:3.0:1789024227.448815:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789024227.448824:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422380032:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789024227.448854:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789024227.448870:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789024227.451291:0:17875:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616000 going to sleep for 11 seconds 00000001:00100000:2.0:1789024227.454811:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789024227.454909:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789024227.454925:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789024227.455296:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17875:x1875927422380032:12345-0@lo:253:mount.lustre.0 Request processed in 6467us (6574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024227.455308:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789024227.455370:0:17875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17875:1875927422380032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789024227.455382:0:17875:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789024227.455385:0:17875:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789024227.455387:0:17875:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789024227.455389:0:17875:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024227.455390:0:17875:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024227.455392:0:17875:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024227.455393:0:17875:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024227.455395:0:17875:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789024227.455396:0:17875:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024227.455397:0:17875:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789024227.455412:0:17875:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789024227.457315:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789024227.457324:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789024227.457348:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457366:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457386:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457393:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457434:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457449:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 17 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.457465:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422380160:0@lo:104: 00000100:00100000:2.0:1789024227.457529:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789024227.457576:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457584:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.457593:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422380288:0@lo:104: 00000100:00100000:2.0:1789024227.457624:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.457657:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024227.457677:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380160 00000100:00100000:2.0:1789024227.457683:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380160 00000100:00100000:2.0:1789024227.457715:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380288 00000100:00100000:2.0:1789024227.457717:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380288 00000100:00100000:2.0:1789024227.457728:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789024227.457735:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422380160:12345-0@lo:104: 00010000:00010000:2.0:1789024227.457752:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457794:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024227.457799:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422380160:12345-0@lo:104: Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024227.457806:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789024227.457820:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789024227.457825:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422380288:12345-0@lo:104: 00010000:00010000:2.0:1789024227.457832:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457861:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789024227.457866:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422380288:12345-0@lo:104: Request processed in 41us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024227.457872:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789024227.457886:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789024227.457892:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457900:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b000 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024227.457905:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457914:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024227.457922:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024227.457933:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789024227.457960:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457966:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024227.457985:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.457992:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0338b000/0xa736ef4b98cb48e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48e9 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458005:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024227.458008:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458014:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024227.458017:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458024:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024227.458030:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024227.458036:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789024227.458044:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458050:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024227.458059:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458066:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb481e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4825 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024227.458080:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024227.458082:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024227.458083:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024227.458106:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422380160:0@lo:104: 00000100:00100000:2.0:1789024227.458113:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422380288:0@lo:104: 00010000:00010000:2.0:1789024227.458130:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024227.459125:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024227.461769:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422380416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024227.461839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.461895:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024227.461902:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422380544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024227.461923:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.462037:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380416 00000100:00100000:3.0:1789024227.462047:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380416 00010000:00010000:3.0:1789024227.462083:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 18 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024227.462114:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380544 00000100:00100000:3.0:1789024227.462118:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380544 00010000:00010000:3.0:1789024227.462130:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 19 pid: 17136 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024227.462162:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789024227.462172:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:3641:x1875927422380416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024227.462184:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024227.462190:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 19 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462201:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 19 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.462352:0:17130:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789024227.462361:0:17130:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789024227.462428:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01322a00/0xa736ef4b98cb48e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb48e2 expref: 19 pid: 17137 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462441:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024227.462527:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3641:x1875927422380416:12345-0@lo:103:ldlm_bl.0 Request processed in 356us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.462535:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789024227.462551:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789024227.462557:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:3641:x1875927422380544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024227.462565:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024227.462569:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462578:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462588:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252f800/0xa736ef4b98cb4825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb481e expref: 17 pid: 17136 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462599:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462608:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789024227.462623:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641837s 00010000:00010000:3.0:1789024227.462629:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462659:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462666:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462673:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462680:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024227.462684:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462692:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462707:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462717:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024227.462742:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:3641:x1875927422380544:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024227.462749:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789024227.462838:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462846:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024227.462853:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb4921 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024227.470829:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422380416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024227.470908:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422380544:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1789024227.473624:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789024227.473702:0:17901:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789024227.473706:0:17901:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789024227.474418:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789024227.474649:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789024227.474979:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422380672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789024227.475060:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024227.475097:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19215780 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.475224:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380672 00000100:00100000:0.0:1789024227.475233:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380672 00000100:00100000:0.0:1789024227.475281:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789024227.475289:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422380672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789024227.475367:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422380672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.475378:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789024227.475549:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422380672:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789024227.475576:0:17903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789024227.475601:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422380800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789024227.475629:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.475662:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616300 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.475738:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380800 00000100:00100000:0.0:1789024227.475742:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380800 00000100:00100000:0.0:1789024227.475770:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789024227.475776:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422380800:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789024227.475872:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422380800:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.475879:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789024227.475948:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422380800:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789024227.476007:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875927422380928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789024227.476030:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.476050:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.476137:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422380928 00000100:00100000:0.0:1789024227.476141:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422380928 00000100:00100000:0.0:1789024227.476541:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789024227.476547:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875927422380928:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789024227.476647:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875927422380928:12345-0@lo:900:lod0001_rec0000.0 Request processed in 100us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.476653:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:1.0:1789024227.476829:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789024227.476860:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789024227.477461:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789024227.479554:0:17875:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789024227.479573:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789024227.479668:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789024227.484888:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789024227.485664:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789024227.485726:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:3.0:1789024227.487294:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90cc3f9ee300 x1875927422380928/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789024243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024227.487313:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875927422380928:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789024227.487405:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422381056:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789024227.487465:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024227.487501:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc34616300 going to sleep for 11 seconds 00000100:00100000:0.0:1789024227.487742:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381056 00000100:00100000:0.0:1789024227.487750:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381056 00000100:00100000:0.0:1789024227.487800:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024227.487809:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422381056:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789024227.487883:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875927422381056:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024227.487890:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:1.0:1789024227.489779:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:3.0:1789024227.489971:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875927422381056:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789024227.490031:0:17903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789024227.491321:0:17875:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789024227.491762:0:17875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789024227.493434:0:17875:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1789024227.500277:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789024227.500345:0:17903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789024227.500349:0:17903:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1789024227.506497:0:17875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789024227.511910:0:17875:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789024227.511953:0:17875:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9dfe056c3988 00100000:10000000:0.0:1789024227.511962:0:17875:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789024227.518989:0:17875:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789024227.519041:0:17875:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789024227.519062:0:17875:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789024227.519081:0:17875:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789024227.523063:0:17875:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024227.523374:0:17875:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789024227.661282:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:2.0:1789024227.853734:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789024228.495543:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789024228.495550:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb03356800 from 8 10000000:01000000:2.0:1789024228.495555:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789024228.495597:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.495609:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.495634:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024228.495658:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024228.495724:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024228.495766:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19215300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024228.495787:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381184 00000100:00100000:2.0:1789024228.495793:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381184 00000100:00100000:2.0:1789024228.495838:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789024228.495846:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17140:x1875927422381184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024228.495859:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024228.495870:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4928 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.495892:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.495913:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 17 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.495921:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5c00, rc 0) 00000100:00100000:2.0:1789024228.495956:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422381184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024228.495963:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789024228.496006:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024228.496020:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496029:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024228.496076:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789024228.496102:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024228.496117:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19215300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024228.496268:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381312 00000100:00100000:2.0:1789024228.496273:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381312 00000100:00100000:2.0:1789024228.496297:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789024228.496303:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422381312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789024228.496317:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789024228.496334:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789024228.496337:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789024228.496695:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422381312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 390us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024228.496711:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789024228.496745:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789024228.496785:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789024228.496792:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496799:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024228.496809:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789024228.496811:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb0401f000 from 8 10000000:01000000:2.0:1789024228.496813:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789024228.496829:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496836:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496844:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024228.496857:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024228.496881:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024228.496901:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19215300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024228.496911:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381440 00000100:00100000:2.0:1789024228.496915:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381440 00000100:00100000:2.0:1789024228.496934:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789024228.496940:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422381440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024228.496954:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024228.496962:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4936 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496976:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496984:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.496991:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c4c00, rc 0) 00000100:00100000:2.0:1789024228.497018:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422381440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024228.497024:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789024228.497049:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024228.497058:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.497065:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024228.497101:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789024228.497125:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024228.497137:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19215300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024228.497165:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381568 00000100:00100000:2.0:1789024228.497169:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381568 00000100:00100000:2.0:1789024228.497189:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789024228.497194:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422381568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789024228.497209:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789024228.497220:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789024228.497222:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789024228.497279:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422381568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024228.497286:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789024228.497313:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422381568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789024228.497341:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789024228.497347:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024228.497354:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024228.500965:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024228.684265:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024228.878246:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789024229.516906:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789024229.708227:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024229.904339:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024230.737010:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00010000:00010000:0.0:1789024230.924313:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024231.757711:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00000001:02000400:0.0:1789024231.775362:0:18146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789024231.952737:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789024232.717866:0:18198:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789024232.718216:0:18198:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789024232.782395:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 0 seconds 00000100:00080000:1.0:1789024232.844404:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789024232.844414:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789024232.844420:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024232.844440:0:12478:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90cc192f7000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024232.844467:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3fab8e00 x1875927422381824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024232.844492:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024232.844496:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024232.844500:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024232.844503:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024232.844530:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024232.844534:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024232.844552:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024232.844555:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024232.844609:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422381824:0@lo:38:kworker.0 00000100:00100000:2.0:1789024232.844656:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422381952:0@lo:400:kworker.0 00000100:00100000:1.0:1789024232.844693:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024232.844757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024232.844802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422382080:0@lo:400:kworker.0 00000100:00100000:2.0:1789024232.844820:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024232.844833:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422381696:0@lo:400:kworker.0 00000100:00100000:1.0:1789024232.844852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024232.844896:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024232.844909:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422382208:0@lo:400:kworker.0 00000100:00100000:2.0:1789024232.844913:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024232.844969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024232.845013:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381696 00000100:00100000:2.0:1789024232.845026:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381696 00000100:00100000:1.0:1789024232.845046:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381952 00000100:00100000:1.0:1789024232.845056:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381952 00000100:00100000:1.0:1789024232.845111:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382208 00000100:00100000:1.0:1789024232.845116:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382208 00000100:00100000:1.0:1789024232.845133:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789024232.845141:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422381952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024232.846424:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422381824 00000100:00100000:0.0:1789024232.846437:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422381824 00000100:00100000:0.0:1789024232.846459:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382080 00000100:00100000:0.0:1789024232.846462:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382080 00000100:00100000:0.0:1789024232.846482:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024232.846490:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875927422381824:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789024232.846516:0:17148:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1789024232.846556:0:17148:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb4944 00000004:00100000:0.0:1789024232.846572:0:17148:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789024232.846578:0:17148:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789024232.846953:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789024232.847041:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3644:x1875927422381696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024232.847183:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422381952:12345-0@lo:400:kworker.0 Request processed in 2041us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.847193:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789024232.847214:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789024232.847305:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024232.847353:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422382208:12345-0@lo:400:kworker.0 Request processed in 52us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.847359:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789024232.847618:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3fab8700 x1875927422382208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024232.847646:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422382208:0@lo:400:kworker.0 00000100:00100000:2.0:1789024232.854792:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3644:x1875927422381696:12345-0@lo:400:kworker.0 Request processed in 7818us (9875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024232.854793:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422382336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024232.854820:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789024232.854865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024232.854921:0:17149:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789024232.854931:0:17149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789024232.855302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422381696:0@lo:400:kworker.0 00010000:00080000:1.0:1789024232.855324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3fabaa00 x1875927422381952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024232.855336:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422381952:0@lo:400:kworker.0 00000100:00100000:0.0:1789024232.857176:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382336 00000100:00100000:0.0:1789024232.857189:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382336 00000100:00100000:2.0:1789024232.857770:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789024232.857786:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875927422382080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024232.857909:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875927422382080:12345-0@lo:400:kworker.0 Request processed in 127us (13057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024232.857917:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024232.858689:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789024232.858710:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422382336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024232.858743:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789024232.858800:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422382336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024232.858808:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789024232.858925:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422382336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024232.859252:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422382080:0@lo:400:kworker.0 00000100:00080000:1.0:1789024232.862644:0:17148:0:(import.c:65:import_set_state_nolock()) ffff90cb033f7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024232.862772:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422381824:12345-0@lo:38:kworker.0 Request processed in 16280us (18080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.862786:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789024232.865561:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789024232.865579:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789024232.865594:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789024232.865598:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc192f7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789024232.865623:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000dd7bf09a): req@ffff90cb03befb80 x1875927422374912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024232.865646:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422381824:0@lo:38:kworker.0 00000100:00100000:0.0:1789024232.865752:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024232.865782:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dbbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789024232.865805:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422374912 00000100:00100000:0.0:1789024232.865814:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422374912 00000100:00100000:0.0:1789024232.865863:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789024232.865872:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1875927422374912:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789024232.865973:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17185:x1875927422374912:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024232.865983:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789024232.866016:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875927422374912:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789024232.866047:0:17185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789024232.866089:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875927422382464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789024232.866129:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024232.866180:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269180 going to sleep for 11 seconds 00000100:00100000:1.0:1789024232.866339:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024232.866350:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422382592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024232.866387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024232.866421:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382464 00000100:00100000:1.0:1789024232.866424:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382464 00000100:00100000:1.0:1789024232.866442:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382592 00000100:00100000:1.0:1789024232.866445:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382592 00000100:00100000:1.0:1789024232.866456:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789024232.866461:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17185:x1875927422382464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789024232.866570:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17185:x1875927422382464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.866578:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789024232.866624:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789024232.866630:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422382592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024232.866659:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024232.866699:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875927422382592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.866706:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789024232.866736:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422382592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024232.866758:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875927422382464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789024232.866827:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875927422382720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789024232.866856:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024232.866872:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08480 going to sleep for 11 seconds 00000100:00100000:1.0:1789024232.866887:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382720 00000100:00100000:1.0:1789024232.866891:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382720 00000100:00100000:1.0:1789024232.866910:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789024232.866917:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875927422382720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789024232.866971:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875927422382720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024232.866979:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789024232.867002:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17185:1875927422382720:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789024232.867036:0:17185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789024232.869206:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789024232.869278:0:17185:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789024232.869284:0:17185:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789024232.972905:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789024233.820312:0:18249:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789024233.820633:0:18249:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789024233.999680:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789024234.768280:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1789024234.859924:0:18297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdab811d70 20000000:00000080:0.0:1789024234.859941:0:18297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cc04912800 uarg=0000000000000000 20000000:01000000:0.0:1789024234.859990:0:18297:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789024234.859997:0:18297:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789024234.860001:0:18297:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789024234.868466:0:18298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789024234.868716:0:18297:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789024234.879620:0:18297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789024234.879663:0:18297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879685:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879694:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879701:0:18297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879748:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879765:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024234.879781:0:18297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875927422382848:0@lo:104: 00000100:00100000:3.0:1789024234.879866:0:18297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024234.879937:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.879946:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 17 pid: 17137 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024234.879954:0:18297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875927422382976:0@lo:104: 00000100:00100000:3.0:1789024234.879974:0:18297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024234.879992:0:18297:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024234.880208:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382848 00000100:00100000:2.0:1789024234.880216:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382848 00000100:00100000:2.0:1789024234.880255:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422382976 00000100:00100000:2.0:1789024234.880259:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422382976 00000100:00100000:2.0:1789024234.880273:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789024234.880282:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:18297:x1875927422382848:12345-0@lo:104: 00010000:00010000:2.0:1789024234.880296:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880361:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024234.880368:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:18297:x1875927422382848:12345-0@lo:104: Request processed in 88us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024234.880374:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789024234.880391:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789024234.880397:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:18297:x1875927422382976:12345-0@lo:104: 00010000:00010000:1.0:1789024234.880404:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024234.880405:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880411:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880428:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024234.880432:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880441:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880444:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789024234.880449:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:18297:x1875927422382976:12345-0@lo:104: Request processed in 52us (474us total) trans 0 rc 0/0 10000000:00010000:1.0:1789024234.880449:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024234.880455:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:1.0:1789024234.880455:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789024234.880469:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024234.880484:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880490:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024234.880509:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880516:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01323800/0xa736ef4b98cb48f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb48f7 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880529:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024234.880531:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024234.880532:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024234.880543:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422383104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024234.880585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024234.880621:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383104 00000100:00100000:1.0:1789024234.880625:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383104 00010000:00010000:1.0:1789024234.880644:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 18 pid: 17138 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880650:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024234.880656:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880662:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024234.880665:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024234.880671:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789024234.880672:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024234.880677:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3641:x1875927422383104:12345-0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789024234.880678:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024234.880683:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789024234.880687:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024234.880692:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 18 pid: 17138 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880698:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880701:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 18 pid: 17138 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880703:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024234.880712:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024234.880716:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789024234.880718:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb47ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb47f4 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024234.880737:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3641:x1875927422383104:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (151us total) trans 0 rc 0/0 00010000:00010000:2.0:1789024234.880740:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024234.880741:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024234.880743:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024234.880743:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789024234.880751:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024234.880753:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024234.880763:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422383232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024234.880785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024234.880837:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422383104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789024234.880891:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383232 00000100:00100000:2.0:1789024234.880895:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383232 00010000:00010000:2.0:1789024234.880910:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 18 pid: 17137 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024234.880928:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789024234.880934:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3642:x1875927422383232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789024234.880941:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024234.880944:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 18 pid: 17137 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880953:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 18 pid: 17137 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880964:0:17898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880973:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880985:0:17898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.880992:0:17898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881005:0:17898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881011:0:17898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881016:0:17898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ac00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024234.881019:0:17898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881027:0:17898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881036:0:17898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024234.881045:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024234.881083:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3642:x1875927422383232:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024234.881089:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789024234.881140:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422383232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024234.881298:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb48f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb48f0 expref: 17 pid: 17138 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024234.881311:0:18297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875927422382848:0@lo:104: 00010000:00010000:3.0:1789024234.881320:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c4a00/0xa736ef4b98cb47f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb47ed expref: 16 pid: 17137 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024234.881330:0:18297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875927422382976:0@lo:104: 00010000:00010000:3.0:1789024234.881343:0:18297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.881352:0:18297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.881359:0:18297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024234.881365:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0338ac00/0xa736ef4b98cb494b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024235.020315:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024236.046407:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789024236.882321:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789024236.882330:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb03356800 from 13 10000000:01000000:3.0:1789024236.882336:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789024236.882383:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024236.882394:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024236.882405:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024236.882445:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789024236.882568:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024236.882623:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024236.890938:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383360 00000100:00100000:1.0:1789024236.890953:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383360 00000100:00100000:1.0:1789024236.891021:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789024236.891031:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+16:17140:x1875927422383360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024236.891048:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024236.891070:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4952 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024236.891098:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024236.891119:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 17 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024236.891128:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01322400, rc 0) 00000100:00100000:1.0:1789024236.891226:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024236.891234:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789024236.891289:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024236.891307:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024236.891317:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024236.891392:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024236.891424:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024236.891479:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c2690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024236.895526:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383488 00000100:00100000:2.0:1789024236.895551:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383488 00000100:00100000:2.0:1789024236.895614:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789024236.895625:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.895814:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024236.895823:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789024236.895901:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.895954:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.895999:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024236.896025:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07dde0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024236.896036:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383616 00000100:00100000:2.0:1789024236.896039:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383616 00000100:00100000:2.0:1789024236.896058:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789024236.896064:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.896136:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024236.896166:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789024236.896206:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789024236.896857:0:18399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789024236.896921:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789024236.896945:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789024236.896956:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.896966:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024236.896975:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789024236.896978:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb0401f000 from 13 10000000:01000000:2.0:1789024236.896980:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789024236.897008:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897016:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897032:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024236.897047:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897082:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024236.897099:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc055140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024236.897116:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383744 00000100:00100000:2.0:1789024236.897121:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383744 00000100:00100000:2.0:1789024236.897166:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789024236.897174:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+17:17140:x1875927422383744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024236.897186:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024236.897199:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4960 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897220:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897231:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 18 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897239:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5800, rc 0) 00000100:00100000:2.0:1789024236.897269:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422383744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024236.897275:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789024236.897306:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024236.897318:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024236.897334:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024236.897375:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897399:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024236.897411:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc055140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024236.897422:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422383872 00000100:00100000:2.0:1789024236.897425:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422383872 00000100:00100000:2.0:1789024236.897444:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789024236.897450:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422383872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897529:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422383872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024236.897535:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789024236.897575:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422383872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897598:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422384000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897633:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024236.897645:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc055140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024236.897655:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422384000 00000100:00100000:2.0:1789024236.897659:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422384000 00000100:00100000:2.0:1789024236.897681:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789024236.897686:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422384000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024236.897750:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:17140:x1875927422384000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024236.897757:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789024236.897802:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422384000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789024236.903222:0:18400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789024236.903983:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789024236.904010:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789024236.904021:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024236.904034:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024237.068548:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024237.965490:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024227/real 1789024227] req@ffff90cc3f9ee680 x1875927422378112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965520:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9ee680 x1875927422378112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965530:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024227/real 1789024227] req@ffff90cc3fae0700 x1875927422377856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965570:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3fae0700 x1875927422377856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965580:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024222/real 1789024222] req@ffff90cc3fabb480 x1875927422375936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965591:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3fabb480 x1875927422375936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965601:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024222/real 1789024222] req@ffff90cc3fabbb80 x1875927422376192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024237.965616:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3fabbb80 x1875927422376192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789024237.965639:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024237.965648:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789024237.965651:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422378112:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789024237.965657:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024237.965661:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789024237.965664:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422377856:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789024237.965669:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789024237.965673:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789024237.965676:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422375936:0@lo:8:kworker.0 00000100:00080000:1.0:1789024237.965680:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1789024237.965682:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1789024237.965683:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789024237.965686:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422376192:0@lo:8:kworker.0 00000100:00100000:0.0:1789024237.965696:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422384128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024237.965775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789024237.966025:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024237.966030:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789024237.966034:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024237.966040:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1789024237.966045:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789024237.966055:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90cc3bd3d800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024237.966074:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9edc00 x1875927422384384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024237.966088:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024237.966091:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789024237.966093:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024237.966095:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:3.0:1789024237.966097:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789024237.966101:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024237.966110:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9eea00 x1875927422384512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024237.966140:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024237.966143:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789024237.966165:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024237.966168:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1789024237.966176:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789024237.966197:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90cc3538e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024237.966209:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9eed80 x1875927422384896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024237.966216:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024237.966218:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789024237.966220:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024237.966222:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:3.0:1789024237.966224:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789024237.966228:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024237.966235:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9ec700 x1875927422385024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789024237.966305:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422384256:0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966337:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024237.966364:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024237.966382:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422385152:0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024237.966432:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422384768:0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966490:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024237.966507:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024237.966511:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422384640:0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966530:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024237.966594:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422384256 00000100:00100000:0.0:1789024237.966602:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422384256 00000100:00100000:0.0:1789024237.966645:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789024237.966654:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3644:x1875927422384256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966697:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:3644:x1875927422384256:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024237.966704:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789024237.966734:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385152 00000100:00100000:0.0:1789024237.966738:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385152 00000100:00100000:0.0:1789024237.966777:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422384640 00000100:00100000:0.0:1789024237.966780:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422384640 00000100:00100000:0.0:1789024237.966793:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789024237.966798:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422385152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966827:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422385152:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024237.966833:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789024237.966844:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024237.966849:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422384640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.966897:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422384640:12345-0@lo:400:kworker.0 Request processed in 47us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024237.966902:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024237.966922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422385280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024237.966953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789024237.966984:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3f9ee680 x1875927422385152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024237.966997:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422385152:0@lo:400:kworker.0 00000100:00100000:0.0:1789024237.967006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422384256:0@lo:400:kworker.0 00010000:00080000:0.0:1789024237.967039:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3f9ef480 x1875927422384640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024237.967048:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422384640:0@lo:400:kworker.0 00000100:00100000:1.0:1789024237.967347:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422384128 00000100:00100000:1.0:1789024237.967352:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422384128 00000100:00100000:1.0:1789024237.967373:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422384768 00000100:00100000:1.0:1789024237.967376:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422384768 00000100:00100000:1.0:1789024237.967386:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385280 00000100:00100000:1.0:1789024237.967388:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385280 00000100:00100000:1.0:1789024237.967399:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789024237.967405:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422384128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024237.967433:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024237.967493:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422384128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024237.967499:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789024237.967512:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789024237.967518:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422384768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024237.967629:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875927422384768:12345-0@lo:400:kworker.0 Request processed in 110us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024237.967635:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789024237.967648:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789024237.967653:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422385280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024237.967670:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024237.967696:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422385280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024237.967700:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789024237.967719:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422384384:0@lo:8:kworker.0 00000400:00000100:1.0:1789024237.967743:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422384384 offset 0 length 520: 4 00000100:00100000:1.0:1789024237.967763:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422384512:0@lo:8:kworker.0 00000400:00000100:1.0:1789024237.967787:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422384512 offset 0 length 520: 4 00000100:00100000:1.0:1789024237.967798:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422384896:0@lo:8:kworker.0 00000400:00000100:1.0:1789024237.967815:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422384896 offset 0 length 520: 4 00000100:00100000:1.0:1789024237.967825:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422385024:0@lo:8:kworker.0 00000400:00000100:1.0:1789024237.967841:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927422385024 offset 0 length 520: 4 00000100:00100000:1.0:1789024237.968075:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422385280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024237.968089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422384128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024237.968115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422384768:0@lo:400:kworker.0 00010000:00010000:3.0:1789024238.093252:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789024239.004109:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789024239.123770:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024239.757589:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789024240.154403:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024241.164433:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789024241.680988:0:18647:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789024241.680992:0:18647:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789024241.680993:0:18647:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789024241.681114:0:18647:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cc30c2a800 00000020:01000004:0.0:1789024241.681134:0:18647:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789024241.681178:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789024241.681193:0:18647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90cc3399b380) 00000020:00000080:0.0:1789024241.681212:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789024241.734337:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789024241.740770:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789024241.741256:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789024241.741583:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789024241.741774:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789024241.742063:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789024241.742355:0:18647:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789024241.743764:0:18647:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789024241.744523:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789024241.744537:0:18647:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789024241.744548:0:18647:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa736ef4b98cb4975 00000020:01000004:2.0:1789024241.744554:0:18647:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789024241.744577:0:18647:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789024241.744580:0:18647:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789024241.744585:0:18647:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789024241.744591:0:18647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789024241.744603:0:18647:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90cc35453380) 00000020:00000080:2.0:1789024241.744613:0:18647:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789024241.745835:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024241.746010:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789024241.746016:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789024241.754043:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789024241.754056:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789024241.754781:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789024241.754788:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789024241.756805:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789024241.760027:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789024241.760039:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789024241.763712:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789024241.763725:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789024241.787751:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789024241.788132:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789024241.788138:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789024241.790819:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789024241.790832:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789024241.791937:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789024241.791945:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789024241.798563:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789024241.798765:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789024241.798773:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789024241.799776:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789024241.799786:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789024241.841248:0:18647:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789024241.841623:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789024241.841631:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789024241.842720:0:18647:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789024241.842728:0:18647:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789024241.843268:0:18647:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789024241.843311:0:18647:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789024241.843319:0:18647:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789024241.856407:0:18647:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789024241.856459:0:18647:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.118@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789024241.856464:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789024241.856466:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789024241.856467:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024241.856469:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024241.856470:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024241.856471:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024241.856473:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024241.856474:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024241.856476:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789024241.856480:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789024241.856482:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789024241.856484:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789024241.856485:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024241.856486:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024241.856487:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024241.856489:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024241.856490:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024241.856491:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024241.856569:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789024241.856599:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789024241.856620:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789024241.856690:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024241.856741:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc093c7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.856811:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385408 00000100:00100000:2.0:1789024241.856820:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385408 00000100:00100000:2.0:1789024241.856888:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789024241.856897:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:18647:x1875927422385408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789024241.856924:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789024241.856927:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789024241.856931:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789024241.858790:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:18647:x1875927422385408:12345-0@lo:253:mount.lustre.0 Request processed in 1875us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024241.858804:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789024241.858922:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385408:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789024241.858937:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789024241.858940:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789024241.858942:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789024241.858955:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789024241.858957:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789024241.858958:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789024241.858959:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789024241.858960:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789024241.858962:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789024241.858963:0:18647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789024241.858984:0:18647:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cc30c2a800 from lustre-OST0000 10000000:01000000:3.0:1789024241.859032:0:18647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789024241.859036:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789024241.859048:0:18647:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cb020a8000 local copy 00010000:00010000:3.0:1789024241.859070:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024241.859221:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024241.859255:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.859523:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc31092480 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.859585:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385536 00000100:00100000:2.0:1789024241.859592:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385536 00000100:00100000:2.0:1789024241.859634:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789024241.859642:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:18647:x1875927422385536:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024241.859723:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:18647:x1875927422385536:12345-0@lo:501:mount.lustre.0 Request processed in 81us (467us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789024241.859731:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789024241.859837:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385536:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789024241.859851:0:18647:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789024241.859873:0:18647:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789024241.859880:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024241.859889:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024241.859915:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cc30c2a800 10000000:01000000:0.0:1789024241.859927:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789024241.859933:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789024241.859936:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789024241.859940:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789024241.859943:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789024241.859975:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024241.859983:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024241.859992:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024241.860005:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789024241.860038:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024241.860071:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1008a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.861400:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385664 00000100:00100000:2.0:1789024241.861410:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385664 00000100:00100000:2.0:1789024241.861456:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789024241.861463:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+18:18647:x1875927422385664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024241.861476:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024241.861493:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc029c5200/0xa736ef4b98cb498a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4983 expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.861528:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc029c5200/0xa736ef4b98cb498a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4983 expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.861539:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc029c5200/0xa736ef4b98cb498a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4983 expref: 19 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.861563:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc029c5200, rc 0) 00000100:00100000:2.0:1789024241.861625:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422385664:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024241.861632:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789024241.861741:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024241.861756:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb498a expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.861766:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb498a expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024241.863865:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789024241.870275:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789024241.873422:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789024241.873481:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789024241.873512:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789024241.873525:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789024241.873538:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789024241.873553:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789024241.873575:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789024241.873580:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789024241.873695:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024241.873759:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024241.873991:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1008a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789024241.879204:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385792 00000100:00100000:1.0:1789024241.879223:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385792 00000100:00100000:1.0:1789024241.879308:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789024241.879320:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422385792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024241.879549:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422385792:12345-0@lo:501:mount.lustre.0 Request processed in 230us (5789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024241.879558:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789024241.879716:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024241.879779:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024241.879831:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024241.879876:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1008a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.879927:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422385920 00000100:00100000:2.0:1789024241.879932:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422385920 00000100:00100000:2.0:1789024241.879958:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789024241.879965:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422385920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789024241.880809:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422385920:12345-0@lo:503:mount.lustre.0 Request processed in 842us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024241.880819:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789024241.881017:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422385920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789024241.881493:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789024241.881596:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024241.881640:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024241.881665:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.881806:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386048 00000100:00100000:2.0:1789024241.881812:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386048 00000100:00100000:2.0:1789024241.881861:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789024241.881868:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422386048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024241.882338:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422386048:12345-0@lo:502:mount.lustre.0 Request processed in 469us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024241.882355:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789024241.882470:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024241.882673:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789024241.882700:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789024241.882713:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789024241.882726:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789024241.882739:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789024241.882753:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789024241.882765:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789024241.882778:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789024241.882791:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789024241.882805:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789024241.882820:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789024241.882830:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789024241.882972:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024241.883009:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.883048:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc31092b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024241.883124:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386176 00000100:00100000:1.0:1789024241.883130:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386176 00000100:00100000:1.0:1789024241.883184:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789024241.883192:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422386176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024241.883266:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422386176:12345-0@lo:502:mount.lustre.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024241.883273:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789024241.884217:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024241.884285:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789024241.884297:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789024241.886101:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789024241.886110:0:18664:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789024241.886116:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.886119:0:18664:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789024241.886124:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789024241.886139:0:18664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90cc312119c0) 00000020:00000080:1.0:1789024241.886187:0:18664:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789024241.886194:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789024241.886288:0:18664:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc30c2a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789024241.886295:0:18664:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789024241.886309:0:18664:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa736ef4b98cb4998 00010000:00010000:2.0:1789024241.897318:0:18664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789024241.899013:0:18664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789024241.902823:0:18664:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789024241.907678:0:18664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789024241.907693:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024241.907700:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907703:0:18664:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789024241.907707:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789024241.907710:0:18664:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789024241.907712:0:18664:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024241.907713:0:18664:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789024241.907715:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789024241.907717:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907719:0:18664:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789024241.907721:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024241.907725:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907726:0:18664:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789024241.907729:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789024241.907731:0:18664:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789024241.907733:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024241.907735:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907737:0:18664:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789024241.907739:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024241.907741:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907753:0:18664:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789024241.907758:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789024241.907788:0:18664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024241.907790:0:18664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024241.907791:0:18664:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789024241.907794:0:18664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789024241.913109:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789024241.913201:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789024241.913227:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb498a expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913242:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0252ec00/0xa736ef4b98cb4983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb498a expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024241.913269:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc30c2a800 from 1 10000000:01000000:1.0:1789024241.913272:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024241.913319:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913327:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913339:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024241.913370:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789024241.913442:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024241.913488:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386304 00000100:00100000:1.0:1789024241.913505:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386304 00000100:00100000:1.0:1789024241.913556:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789024241.913566:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:18647:x1875927422386304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024241.913579:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024241.913590:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb499f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913612:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913624:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913632:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323800, rc 0) 00000100:00100000:1.0:1789024241.913675:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386304:12345-0@lo:101:mount.lustre.0 Request processed in 111us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024241.913682:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789024241.913728:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc19994cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024241.913753:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024241.913768:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024241.913778:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024241.916477:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789024241.916831:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789024241.919823:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789024241.920738:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789024241.920764:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789024241.920770:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789024241.920882:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024241.920955:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024241.921012:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc199940c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024241.922116:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386432 00000100:00100000:0.0:1789024241.922128:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386432 00000100:00100000:0.0:1789024241.922196:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789024241.922206:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024241.922378:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386432:12345-0@lo:501:mount.lustre.0 Request processed in 173us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024241.922386:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789024241.923602:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024241.923723:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024241.923795:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024241.923829:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc199940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789024241.924012:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386560 00000100:00100000:2.0:1789024241.924020:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386560 00000100:00100000:2.0:1789024241.924069:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789024241.924080:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789024241.924241:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386560:12345-0@lo:503:mount.lustre.0 Request processed in 163us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024241.924256:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789024241.925118:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789024241.925772:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789024241.926641:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024241.926712:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.926764:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc0a627f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024241.927110:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386688 00000100:00100000:1.0:1789024241.927119:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386688 00000100:00100000:1.0:1789024241.927203:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789024241.927213:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024241.927355:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386688:12345-0@lo:502:mount.lustre.0 Request processed in 133us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024241.927362:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789024241.927699:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024241.929139:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789024241.929220:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789024241.929234:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789024241.929245:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789024241.929255:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789024241.929267:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789024241.929298:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789024241.929311:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789024241.929325:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789024241.929336:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789024241.929358:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789024241.929409:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024241.929480:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.929892:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc22d74480 going to sleep for 11 seconds 00000100:00100000:1.0:1789024241.934707:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386816 00000100:00100000:1.0:1789024241.934726:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386816 00000100:00100000:0.0:1789024241.934921:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789024241.934943:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024241.935175:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386816:12345-0@lo:502:mount.lustre.0 Request processed in 215us (5666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024241.935183:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789024241.935374:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789024241.935487:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789024241.935764:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789024241.936744:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024241.936755:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936757:0:18668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789024241.936764:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc30c2a800 00000020:00000080:1.0:1789024241.936766:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024241.936773:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024241.936776:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936777:0:18668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789024241.936779:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024241.936781:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936782:0:18668:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789024241.936786:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc30c2a800 00000020:00000080:1.0:1789024241.936787:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024241.936864:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024241.936868:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936870:0:18668:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789024241.936873:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024241.936875:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936877:0:18668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024241.936880:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc30c2a800 00000020:00000080:1.0:1789024241.936882:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024241.936900:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024241.936903:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936911:0:18668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789024241.936914:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789024241.936917:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.936918:0:18668:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789024241.936921:0:18668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc30c2a800 00000020:00000080:1.0:1789024241.936923:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789024241.941461:0:18668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789024241.941470:0:18668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789024241.941474:0:18668:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789024241.941478:0:18668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789024241.954613:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789024241.954682:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789024241.954701:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.954715:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024241.954770:0:18647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789024241.954774:0:18647:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cc30c2a800 10000000:01000000:2.0:1789024241.954777:0:18647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cc30c2a800 10000000:01000000:2.0:1789024241.954781:0:18647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789024241.954786:0:18647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc30c2a800 from 1 10000000:01000000:2.0:1789024241.954790:0:18647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789024241.954828:0:18647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.954993:0:18647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.955008:0:18647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024241.955033:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789024241.955104:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024241.956644:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc087f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789024241.965657:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422386944 00000100:00100000:3.0:1789024241.965676:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422386944 00000100:00100000:3.0:1789024241.965749:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789024241.965761:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:18647:x1875927422386944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789024241.965792:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024241.965811:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb49b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb49ad expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024241.966012:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb49b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb49ad expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024241.966025:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0338a600/0xa736ef4b98cb49b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb49ad expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024241.966036:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a600, rc 0) 00000100:00100000:3.0:1789024241.966120:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422386944:12345-0@lo:101:mount.lustre.0 Request processed in 361us (11016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024241.966128:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789024241.969625:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bec700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422386944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024241.969662:0:18647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49b4 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024241.969694:0:18647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb49b4 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024241.981711:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789024241.984635:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789024241.987095:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789024241.987190:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789024241.987210:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789024241.987223:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789024241.987235:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789024241.987250:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789024241.987264:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789024241.987278:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789024241.987290:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789024241.987305:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789024241.987318:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789024241.987332:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789024241.987346:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789024241.987360:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789024241.987385:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789024241.987400:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789024241.987430:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789024241.987446:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789024241.987459:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789024241.987472:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789024241.987486:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789024241.988711:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789024241.988738:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789024241.988750:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789024241.988761:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789024241.988775:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789024241.988788:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789024241.988799:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789024241.988811:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789024241.988824:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789024241.988838:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789024241.988867:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789024241.988899:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789024241.988916:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789024241.988929:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789024241.989397:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789024241.989418:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789024241.989452:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789024241.989459:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789024241.989593:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024241.989662:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.989712:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc22d74b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789024241.993641:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387072 00000100:00100000:0.0:1789024241.993661:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387072 00000100:00100000:0.0:1789024241.993724:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789024241.993735:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024241.993969:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387072:12345-0@lo:501:mount.lustre.0 Request processed in 236us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024241.993977:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789024241.994302:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024241.994367:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024241.994431:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024241.994470:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc22d74b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789024241.997692:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387200 00000100:00100000:0.0:1789024241.997714:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387200 00000100:00100000:0.0:1789024241.997797:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789024241.997821:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024241.998070:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387200:12345-0@lo:503:mount.lustre.0 Request processed in 252us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024241.998078:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789024242.005201:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789024242.008479:0:18647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789024242.008620:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024242.008712:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024242.008767:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc07428240 going to sleep for 11 seconds 00000100:00100000:0.0:1789024242.009752:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387328 00000100:00100000:0.0:1789024242.009766:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387328 00000100:00100000:0.0:1789024242.009852:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789024242.009865:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024242.011096:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387328:12345-0@lo:502:mount.lustre.0 Request processed in 1226us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.011110:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789024242.011568:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024242.011804:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789024242.013202:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789024242.013246:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789024242.013263:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789024242.013274:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789024242.013285:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789024242.013320:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789024242.013333:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789024242.013344:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789024242.013358:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789024242.013380:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789024242.013395:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789024242.013409:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789024242.013422:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789024242.013435:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789024242.013447:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789024242.015390:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789024242.015420:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789024242.015433:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789024242.015448:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789024242.015460:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789024242.016708:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789024242.016786:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789024242.016807:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789024242.016821:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1789024242.017596:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1789024242.017631:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1789024242.017647:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1789024242.017661:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1789024242.017676:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1789024242.017688:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1789024242.017702:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1789024242.017713:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1789024242.017725:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1789024242.017738:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1789024242.017751:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1789024242.017763:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1789024242.017774:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1789024242.017805:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1789024242.017818:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1789024242.017831:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1789024242.021637:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1789024242.021674:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1789024242.021691:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1789024242.021708:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1789024242.021724:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1789024242.021741:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1789024242.021758:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1789024242.021827:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024242.021920:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024242.022117:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc22d74b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789024242.026955:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387456 00000100:00100000:0.0:1789024242.026974:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387456 00000100:00100000:0.0:1789024242.027038:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789024242.027049:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024242.029712:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387456:12345-0@lo:502:mount.lustre.0 Request processed in 2655us (7781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.029727:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789024242.030126:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789024242.031792:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789024242.031827:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789024242.031873:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024242.031952:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024242.031996:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3c029180 going to sleep for 11 seconds 00000100:00100000:2.0:1789024242.032253:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387584 00000100:00100000:2.0:1789024242.032263:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387584 00000100:00100000:2.0:1789024242.032322:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789024242.032331:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024242.032459:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422387584:12345-0@lo:502:mount.lustre.0 Request processed in 128us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024242.032466:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789024242.034514:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422387584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789024242.034632:0:18647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789024242.034648:0:18647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789024242.036266:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789024242.036284:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90cc33998000) 00000020:00000080:0.0:1789024242.036309:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789024242.036415:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc30c2a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789024242.036420:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc30c2a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789024242.036422:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc30c2a800 3 00010000:00080000:0.0:1789024242.036454:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc4159f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.118@tcp at head 00010000:00010000:1.0:1789024242.039550:0:18674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789024242.039809:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789024242.039878:0:18674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789024242.039892:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa736ef4b98cb49c2 00000100:00080000:1.0:1789024242.039902:0:18674:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789024242.039913:0:18674:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90cc4159f800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024242.039959:0:18674:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3faba300 x1875927422387712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024242.039986:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789024242.040038:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.040042:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.040044:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.040046:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.040080:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.040083:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.040086:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.040089:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024242.040123:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422387840:0@lo:400:kworker.0 00000100:00100000:0.0:1789024242.040603:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422387712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789024242.044477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024242.044582:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387712 00000100:00100000:0.0:1789024242.044590:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387712 00000100:00100000:0.0:1789024242.044623:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789024242.044631:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422387712:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789024242.044658:0:17144:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1789024242.044702:0:17144:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa736ef4b98cb49c9 00000004:00100000:0.0:1789024242.045211:0:17144:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789024242.045251:0:17144:0:(import.c:65:import_set_state_nolock()) ffff90cc4159d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024242.045315:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875927422387712:12345-0@lo:38:llog_process_th.0 Request processed in 684us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.045324:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789024242.045376:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3faba300 x1875927422387712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024242.045387:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789024242.045395:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789024242.045403:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789024242.045409:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789024242.045412:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc4159f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789024242.045418:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875927422387712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789024242.045863:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422388096:0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.045905:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024242.045930:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024242.045936:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422388224:0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.045958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024242.045984:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388096 00000100:00100000:2.0:1789024242.045989:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388096 00000100:00100000:2.0:1789024242.046019:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789024242.046026:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422388096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.046062:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422388096:12345-0@lo:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024242.046069:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789024242.046089:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388224 00000100:00100000:2.0:1789024242.046093:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388224 00000100:00100000:2.0:1789024242.046111:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789024242.046115:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422388224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.046177:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422388224:12345-0@lo:400:kworker.0 Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024242.046183:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789024242.046214:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3fabbb80 x1875927422388224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024242.046224:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422388224:0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.046234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422388096:0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.049642:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422387968:0@lo:400:kworker.0 00000100:00100000:2.0:1789024242.049714:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024242.051265:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387968 00000100:00100000:0.0:1789024242.051284:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387968 00000100:00100000:0.0:1789024242.051342:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789024242.051353:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024242.051444:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875927422387968:12345-0@lo:400:kworker.0 Request processed in 94us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.051452:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789024242.051510:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3fab8a80 x1875927422387968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024242.051524:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875927422387968:0@lo:400:kworker.0 00000100:00100000:1.0:1789024242.051875:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024242.054201:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422387840 00000100:00100000:3.0:1789024242.054214:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422387840 00000100:00100000:3.0:1789024242.054283:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789024242.054294:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422387840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024242.054398:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422387840:12345-0@lo:400:kworker.0 Request processed in 107us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024242.054405:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:01000004:2.0:1789024242.056922:0:18674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789024242.056941:0:18674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90cc35450000) 00000020:00000080:2.0:1789024242.056967:0:18674:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789024242.057050:0:18674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc30c2a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789024242.057054:0:18674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc30c2a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789024242.057057:0:18674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc30c2a800 3 00010000:00080000:2.0:1789024242.057099:0:18674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cc0706e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.118@tcp at head 00000100:00100000:1.0:1789024242.058730:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422387840:0@lo:400:kworker.0 00010000:00010000:3.0:1789024242.060962:0:18674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789024242.061212:0:18674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789024242.061261:0:18674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789024242.061274:0:18674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa736ef4b98cb49d7 00000100:00080000:3.0:1789024242.061284:0:18674:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789024242.061297:0:18674:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90cc0706e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024242.061337:0:18674:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9ed180 x1875927422388352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024242.061360:0:18674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789024242.063612:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422388352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789024242.063720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024242.063811:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388352 00000100:00100000:0.0:1789024242.063820:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388352 00000100:00100000:0.0:1789024242.063858:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789024242.063865:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875927422388352:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789024242.063897:0:17144:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1789024242.063952:0:17144:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa736ef4b98cb49de 00000004:00100000:0.0:1789024242.063968:0:17144:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789024242.064008:0:17144:0:(import.c:65:import_set_state_nolock()) ffff90cb038e8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024242.064063:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875927422388352:12345-0@lo:38:llog_process_th.0 Request processed in 196us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.064071:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789024242.064116:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90cc3f9ed180 x1875927422388352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024242.064128:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789024242.066950:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.066960:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.066963:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.066966:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.066970:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.066973:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024242.066976:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024242.066979:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789024242.067028:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000040:00080000:3.0:1789024242.067365:0:18674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789024242.067678:0:18647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789024242.067713:0:18647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789024242.067737:0:18647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49b4 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024242.067749:0:18647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc029c4a00/0xa736ef4b98cb49ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49b4 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789024242.067809:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789024242.067811:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789024242.067813:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024242.067814:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024242.067815:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024242.067816:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024242.067817:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789024242.067819:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024242.067820:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789024242.067824:0:18647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789024242.067826:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789024242.067827:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789024242.067828:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789024242.067829:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789024242.067830:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789024242.067831:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789024242.067832:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789024242.067833:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789024242.067834:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789024242.067857:0:18647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789024242.067875:0:18647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422388480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789024242.067941:0:18647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024242.067974:0:18647:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3c0296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024242.073782:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388480 00000100:00100000:1.0:1789024242.073805:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388480 00000100:00100000:1.0:1789024242.073882:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789024242.073894:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422388480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789024242.073931:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789024242.073947:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1789024242.074535:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789024242.074544:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789024242.074549:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc0706e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789024242.074559:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875927422388352:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789024242.083132:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789024242.083378:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789024242.083626:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789024242.083632:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789024242.083656:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.083679:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 21 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.083686:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.083693:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.083733:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 21 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.083758:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 21 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024242.083775:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422388608:0@lo:104: 00000100:00100000:1.0:1789024242.084027:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:18647:x1875927422388480:12345-0@lo:253:mount.lustre.0 Request processed in 10133us (16082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024242.084047:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789024242.084321:0:18647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:18647:1875927422388480:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789024242.084334:0:18647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789024242.084337:0:18647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789024242.084338:0:18647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789024242.084339:0:18647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789024242.084341:0:18647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789024242.084342:0:18647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789024242.084343:0:18647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789024242.084345:0:18647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789024242.084346:0:18647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789024242.084348:0:18647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789024242.084359:0:18647:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789024242.085279:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789024242.085474:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.085488:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 20 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024242.085511:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422388736:0@lo:104: 00000100:00100000:3.0:1789024242.085552:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024242.086049:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb025f2540 going to sleep for 11 seconds 00000001:00000004:2.0:1789024242.086415:0:18647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1789024242.087572:0:17126:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789024242.087597:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388608 00000100:00100000:0.0:1789024242.087606:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388608 00000100:00100000:0.0:1789024242.087644:0:17126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388736 00000100:00100000:0.0:1789024242.087647:0:17126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388736 00000100:00100000:0.0:1789024242.087660:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024242.087669:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422388608:12345-0@lo:104: 00010000:00010000:0.0:1789024242.087684:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.087812:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789024242.087819:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422388608:12345-0@lo:104: Request processed in 151us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.087825:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024242.087842:0:17126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024242.087847:0:17126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc2c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422388736:12345-0@lo:104: 00010000:00010000:0.0:1789024242.087854:0:17126:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.087887:0:17126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789024242.087892:0:17126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc2c273c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422388736:12345-0@lo:104: Request processed in 46us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.087912:0:17126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789024242.087949:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024242.087955:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.087963:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c4200 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024242.087967:0:18299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.087975:0:18299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024242.087981:0:18299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024242.087987:0:18299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789024242.088021:0:18299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088027:0:18299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024242.088048:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088054:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c4200/0xa736ef4b98cb4936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb493d expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088083:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024242.088086:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088103:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:0.0:1789024242.088106:0:18299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088112:0:18299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789024242.088118:0:18299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024242.088124:0:18299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789024242.088137:0:18299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088228:0:18299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789024242.088238:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088245:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c5600/0xa736ef4b98cb4928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb492f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088259:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024242.088261:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024242.088263:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024242.088285:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422388864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024242.088320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024242.088355:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024242.088361:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422388992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024242.088395:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024242.088426:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388864 00000100:00100000:0.0:1789024242.088431:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388864 00010000:00010000:0.0:1789024242.088449:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 21 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024242.088469:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422388992 00000100:00100000:0.0:1789024242.088472:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422388992 00010000:00010000:0.0:1789024242.088482:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 22 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024242.088511:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024242.088518:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:3641:x1875927422388864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024242.088529:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024242.088534:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 22 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088544:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 22 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088561:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024242.088594:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:3641:x1875927422388864:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.088600:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024242.088612:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024242.088618:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3641:x1875927422388992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024242.088626:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024242.088630:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 21 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088648:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 21 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088660:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088668:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789024242.088681:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641837s 00010000:00010000:0.0:1789024242.088685:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088692:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088698:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088703:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088708:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024242.088712:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088719:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088726:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024242.088741:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024242.088768:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3641:x1875927422388992:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024242.088774:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024242.088849:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422388992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024242.088858:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422388864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789024242.089014:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024242.089189:0:17127:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1789024242.089626:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c4c00/0xa736ef4b98cb493d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb4936 expref: 20 pid: 17138 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024242.089644:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422388608:0@lo:104: 00010000:00010000:3.0:1789024242.089655:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c5c00/0xa736ef4b98cb492f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb4928 expref: 19 pid: 17136 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024242.089664:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422388736:0@lo:104: 00010000:00010000:3.0:1789024242.089681:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.089691:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.089713:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024242.089719:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0338b000/0xa736ef4b98cb49e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789024242.100867:0:18647:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789024242.100878:0:18647:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789024242.100915:0:18647:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789024242.100967:0:18647:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789024242.100992:0:18647:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789024242.101025:0:18647:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789024242.101855:0:18647:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024242.102080:0:18647:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789024242.190027:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024243.085616:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422389120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024243.085690:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024243.085745:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389120 00000100:00100000:2.0:1789024243.085752:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389120 00000100:00100000:2.0:1789024243.085796:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789024243.085805:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422389120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024243.085837:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789024243.085884:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422389120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024243.085891:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789024243.085935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422389120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024243.086651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422389248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024243.086686:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024243.086755:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389248 00000100:00100000:0.0:1789024243.086760:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389248 00000100:00100000:0.0:1789024243.086795:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789024243.086803:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422389248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024243.086823:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789024243.086861:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422389248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024243.086867:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789024243.086932:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422389248:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1789024243.138383:0:18727:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789024243.138634:0:18727:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789024243.212406:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789024243.406218:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789024243.406224:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb03356800 from 9 10000000:01000000:3.0:1789024243.406228:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789024243.406286:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024243.406298:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024243.406310:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024243.406338:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789024243.406419:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024243.406458:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024243.408904:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389376 00000100:00100000:1.0:1789024243.408929:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389376 00000100:00100000:1.0:1789024243.409001:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789024243.409011:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+19:17140:x1875927422389376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024243.409028:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024243.409050:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb49ec expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024243.409077:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024243.409089:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 20 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024243.409099:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323e00, rc 0) 00000100:00100000:1.0:1789024243.409194:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:17140:x1875927422389376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024243.409201:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789024243.409230:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024243.409251:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024243.409286:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024243.409354:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789024243.411082:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024243.411131:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc04df4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024243.411528:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389504 00000100:00100000:1.0:1789024243.411544:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389504 00000100:00100000:1.0:1789024243.411591:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789024243.411599:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:17140:x1875927422389504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789024243.411619:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789024243.411635:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789024243.411637:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789024243.414458:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:17140:x1875927422389504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2853us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024243.414471:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789024243.422226:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789024243.422305:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789024243.422315:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.422325:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024243.422335:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789024243.422337:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb0401f000 from 9 10000000:01000000:2.0:1789024243.422345:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789024243.422375:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.422382:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.422390:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024243.422409:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024243.422464:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024243.424577:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc08774240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024243.424608:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389632 00000100:00100000:2.0:1789024243.424616:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389632 00000100:00100000:2.0:1789024243.424682:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789024243.424690:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:17140:x1875927422389632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024243.424703:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024243.424720:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb49fa expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.424744:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.424755:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.424763:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4400, rc 0) 00000100:00100000:2.0:1789024243.424814:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422389632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024243.424834:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789024243.425327:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024243.425344:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.425354:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024243.425416:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789024243.425453:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024243.425478:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb000 going to sleep for 11 seconds 00000100:00100000:2.0:1789024243.425503:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389760 00000100:00100000:2.0:1789024243.425507:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389760 00000100:00100000:2.0:1789024243.425533:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789024243.425539:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422389760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789024243.425551:0:17138:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789024243.425569:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789024243.425573:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789024243.425648:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422389760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024243.425655:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789024243.425990:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422389760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789024243.426041:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789024243.426047:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024243.426067:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024244.236325:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024245.004935:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789024245.260372:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024246.284268:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789024247.188172:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024247.188179:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024247.188181:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024247.188184:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024247.188211:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024247.188213:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789024247.188216:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024247.188219:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024247.188302:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422389888:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188419:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422390400:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188465:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188502:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789024247.188508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422390016:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188780:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422390528:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422390144:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422390656:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188911:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188923:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024247.188928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422390272:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.188962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024247.188998:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422389888 00000100:00100000:1.0:1789024247.189006:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422389888 00000100:00100000:1.0:1789024247.189051:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789024247.189060:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3641:x1875927422389888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189112:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3641:x1875927422389888:12345-0@lo:400:kworker.0 Request processed in 53us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189119:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789024247.189173:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390400 00000100:00100000:1.0:1789024247.189176:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390400 00000100:00100000:1.0:1789024247.189196:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390528 00000100:00100000:1.0:1789024247.189199:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390528 00000100:00100000:1.0:1789024247.189221:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390144 00000100:00100000:1.0:1789024247.189224:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390144 00000100:00100000:1.0:1789024247.189311:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390656 00000100:00100000:1.0:1789024247.189315:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390656 00000100:00100000:1.0:1789024247.189329:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789024247.189335:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422390400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189367:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422390400:12345-0@lo:400:kworker.0 Request processed in 32us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189384:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789024247.189398:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789024247.189404:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422390528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189432:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422390528:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189438:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789024247.189461:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789024247.189467:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422390144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189497:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422390144:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189503:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789024247.189515:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789024247.189521:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189547:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422390656:12345-0@lo:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189552:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789024247.189711:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390016 00000100:00100000:1.0:1789024247.189716:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390016 00000100:00100000:1.0:1789024247.189754:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390272 00000100:00100000:1.0:1789024247.189758:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390272 00000100:00100000:1.0:1789024247.189771:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789024247.189777:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422390016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189809:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422390016:12345-0@lo:400:kworker.0 Request processed in 32us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189815:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789024247.189835:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789024247.189840:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422390272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.189867:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422390272:12345-0@lo:400:kworker.0 Request processed in 27us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024247.189873:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789024247.189920:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422390016:0@lo:400:kworker.0 00010000:00080000:1.0:1789024247.189933:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3fab8a80 x1875927422390528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024247.189943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422390528:0@lo:400:kworker.0 00000100:00100000:1.0:1789024247.190018:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422389888:0@lo:400:kworker.0 00010000:00080000:1.0:1789024247.190028:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3fabb100 x1875927422390400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024247.190037:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422390400:0@lo:400:kworker.0 00000100:00080000:1.0:1789024247.190078:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024247.190082:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024247.190098:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422390272:0@lo:400:kworker.0 00010000:00080000:1.0:1789024247.190108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3fab8380 x1875927422390144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024247.190116:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422390144:0@lo:400:kworker.0 00010000:00080000:1.0:1789024247.190125:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3fabb480 x1875927422390656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024247.190131:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422390656:0@lo:400:kworker.0 00010000:00010000:0.0:1789024247.311335:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024248.204455:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422390784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024248.204536:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024248.204601:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390784 00000100:00100000:2.0:1789024248.204610:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390784 00000100:00100000:2.0:1789024248.204660:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789024248.204669:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422390784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024248.204708:0:18205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789024248.204755:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422390784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024248.204762:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789024248.204824:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422390784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024248.205013:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422390912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024248.205047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024248.205083:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422390912 00000100:00100000:0.0:1789024248.205087:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422390912 00000100:00100000:0.0:1789024248.205114:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789024248.205121:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422390912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024248.205141:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789024248.205192:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422390912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024248.205215:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789024248.205249:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422390912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789024248.333795:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789024249.232551:0:19017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789024249.356386:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024250.000838:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789024250.166012:0:19069:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024250.166705:0:19069:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789024250.381546:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789024251.114057:0:19120:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024251.114352:0:19120:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789024251.404518:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024252.305234:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024237/real 1789024237] req@ffff90cc3f9eed80 x1875927422384896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.305265:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9eed80 x1875927422384896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.305274:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024237/real 1789024237] req@ffff90cc3f9ec700 x1875927422385024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024252 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.305284:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9ec700 x1875927422385024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024252 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789024252.305303:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789024252.305311:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789024252.305314:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422384896:0@lo:8:kworker.0 00000100:00080000:0.0:1789024252.305319:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789024252.305323:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789024252.305325:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422385024:0@lo:8:kworker.0 00000100:00100000:0.0:1789024252.307177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422391040:0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.307251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789024252.307355:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024252.307360:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789024252.307362:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024252.307365:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789024252.307863:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391040 00000100:00100000:1.0:1789024252.307871:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391040 00000100:00100000:1.0:1789024252.307922:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789024252.307932:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3642:x1875927422391040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789024252.312582:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024252.312593:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789024252.312597:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789024252.312622:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:2.0:1789024252.312628:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789024252.312641:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90cc3538e800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024252.312680:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb03beed80 x1875927422391552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789024252.312710:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024252.312714:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789024252.312716:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789024252.312719:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:2.0:1789024252.312722:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789024252.312726:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024252.312737:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb03bef480 x1875927422391680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024252.312803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422391168:0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.312866:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.312902:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422391936:0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.312931:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.312961:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789024252.312967:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422391296:0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.312988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024252.319573:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3642:x1875927422391040:12345-0@lo:400:kworker.0 Request processed in 11633us (12313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024252.319589:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789024252.319737:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422392064:0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.319797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.319876:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422391040:0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.320266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.320302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.320358:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422391552:0@lo:8:kworker.0 00000100:00100000:0.0:1789024252.320390:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.320441:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422391680:0@lo:8:kworker.0 00000100:00100000:0.0:1789024252.320462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.320494:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391168 00000100:00100000:0.0:1789024252.320501:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391168 00000100:00100000:0.0:1789024252.320539:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391424 00000100:00100000:0.0:1789024252.320543:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391424 00000100:00100000:0.0:1789024252.320557:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789024252.320565:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422391168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.320612:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422391168:12345-0@lo:400:kworker.0 Request processed in 48us (7746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024252.320618:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789024252.320633:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789024252.320640:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.320672:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422391424:12345-0@lo:400:kworker.0 Request processed in 33us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024252.320679:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789024252.320704:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422391424:0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.320721:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422391808:0@lo:400:kworker.0 00000100:00100000:3.0:1789024252.326063:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391552 00000100:00100000:3.0:1789024252.326079:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391552 00000100:00100000:3.0:1789024252.326118:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391680 00000100:00100000:3.0:1789024252.326121:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391680 00000100:00100000:3.0:1789024252.326136:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789024252.326162:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422391552:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789024252.326203:0:18651:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 570 last 0 00000020:00000080:3.0:1789024252.326234:0:18651:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb4a08 00002000:00100000:3.0:1789024252.326251:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90cb04002800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789024252.326255:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789024252.326258:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789024252.326452:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789024252.326477:0:18651:0:(import.c:65:import_set_state_nolock()) ffff90cb04002000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024252.326567:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422391552:12345-0@lo:8:kworker.0 Request processed in 422us (6175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024252.326575:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789024252.326608:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789024252.326613:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422391680:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789024252.326625:0:18651:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789024252.326995:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03beed80 x1875927422391552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789024272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.327008:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789024252.327019:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789024252.327029:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789024252.327035:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789024252.327046:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789024252.327078:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789024252.327084:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422391552:0@lo:8:kworker.0 00000004:00080000:2.0:1789024252.329746:0:17885:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789024252.329777:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392320:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789024252.329852:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.329866:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024252.334193:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391936 00000100:00100000:1.0:1789024252.334217:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391936 00000004:00080000:1.0:1789024252.334242:0:17884:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789024252.334340:0:17884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 570370193400ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789024252.334347:0:17884:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789024252.338321:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391296 00000100:00100000:2.0:1789024252.338339:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391296 00000100:00100000:2.0:1789024252.338417:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392064 00000100:00100000:2.0:1789024252.338421:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392064 00000100:00100000:2.0:1789024252.338456:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789024252.338467:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.338556:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422391296:12345-0@lo:400:kworker.0 Request processed in 91us (25567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024252.338564:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789024252.338580:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789024252.338587:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.338616:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422392064:12345-0@lo:400:kworker.0 Request processed in 31us (18819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024252.338621:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789024252.338655:0:18653:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789024252.338663:0:18653:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1789024252.338786:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bf480 x1875927422392064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024252.338800:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422392064:0@lo:400:kworker.0 00000100:00100000:2.0:1789024252.338816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422391168:0@lo:400:kworker.0 00010000:00080000:2.0:1789024252.338842:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03befb80 x1875927422391296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024252.338850:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422391296:0@lo:400:kworker.0 00000004:00080000:2.0:1789024252.345898:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789024252.351450:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422392192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024252.351531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.351602:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392192 00000100:00100000:2.0:1789024252.351610:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392192 00000100:00100000:2.0:1789024252.351659:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789024252.351670:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875927422392192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024252.351701:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789024252.351751:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.351777:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875927422392192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024252.351786:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789024252.351804:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bd500 x1875927422392192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.351825:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422392192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024252.351849:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422391808 00000100:00100000:0.0:1789024252.351853:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422391808 00000100:00100000:0.0:1789024252.351888:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789024252.351895:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024252.351931:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875927422391808:12345-0@lo:400:kworker.0 Request processed in 36us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024252.351937:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789024252.351964:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03bedc00 x1875927422391808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.351973:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875927422391808:0@lo:400:kworker.0 00000100:00080000:1.0:1789024252.355743:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789024252.355754:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024252.355856:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789024252.355965:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789024252.355977:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422391936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024252.356083:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422391936:12345-0@lo:400:kworker.0 Request processed in 110us (43150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024252.356090:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789024252.356139:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392320 00000100:00100000:1.0:1789024252.356164:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392320 00000100:00100000:1.0:1789024252.356391:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789024252.356412:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875927422392320:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789024252.356493:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422391680:12345-0@lo:8:kworker.0 Request processed in 29876us (36027us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789024252.356504:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789024252.356564:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024252.356570:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789024252.356573:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422391680:0@lo:8:kworker.0 00010000:00080000:0.0:1789024252.358192:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03bef100 x1875927422391936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.358211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422391936:0@lo:400:kworker.0 00002000:00080000:0.0:1789024252.358902:0:19173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789024252.358909:0:19173:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789024252.358991:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17885:x1875927422392320:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2592us (29138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024252.359017:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789024252.359021:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bf100 x1875927422392320/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789024268 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024252.359036:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392320:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789024252.359792:0:17885:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789024252.359836:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392448:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789024252.359880:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024252.359913:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc066d7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024252.359931:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392448 00000100:00100000:1.0:1789024252.359946:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392448 00000100:00100000:1.0:1789024252.360001:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789024252.360012:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1875927422392448:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789024252.360036:0:18653:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789024252.360097:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17885:x1875927422392448:12345-0@lo:5:osp-pre-0-1.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024252.360105:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789024252.360453:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bf100 x1875927422392448/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789024268 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.360467:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392448:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789024252.360477:0:17885:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789024252.360506:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392576:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789024252.360537:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.360572:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024252.360698:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392576 00000100:00100000:1.0:1789024252.360704:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392576 00000100:00100000:1.0:1789024252.360739:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789024252.360748:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17885:x1875927422392576:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789024252.360775:0:18651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1789024252.417036:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789024252.417061:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789024252.419537:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17885:x1875927422392576:12345-0@lo:5:osp-pre-0-1.0 Request processed in 58782us (58989us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789024252.419551:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789024252.420627:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf96d80 x1875927422392576/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789024268 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.420646:0:17885:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789024252.420655:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17885:1875927422392576:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789024252.420679:0:17885:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789024252.421137:0:17885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875927422392704:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789024252.421248:0:17885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024252.421294:0:17885:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc10203f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789024252.421352:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392704 00000100:00100000:1.0:1789024252.421365:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392704 00000100:00100000:1.0:1789024252.421434:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789024252.421445:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875927422392704:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789024252.421676:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17885:x1875927422392704:12345-0@lo:900:osp-pre-0-1.0 Request processed in 232us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024252.421684:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789024252.423948:0:17885:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf96d80 x1875927422392704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789024268 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024252.423973:0:17885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17885:1875927422392704:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1789024252.429980:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024253.326299:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422392832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024253.326381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024253.326476:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392832 00000100:00100000:1.0:1789024253.327483:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392832 00000100:00100000:1.0:1789024253.327634:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789024253.327646:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422392832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024253.327687:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024253.327830:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422392832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024253.327837:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789024253.328095:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422392832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024253.333373:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422392960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789024253.333458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024253.333834:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422392960 00000100:00100000:3.0:1789024253.333842:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422392960 00000100:00100000:3.0:1789024253.333894:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789024253.333903:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422392960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789024253.333936:0:18205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789024253.339794:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422392960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5881us (6324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024253.339809:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789024253.342869:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422392960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024253.452344:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024254.492605:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024255.248825:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789024255.502638:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024256.528958:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789024257.420708:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024257.420716:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789024257.420719:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024257.420722:0:12478:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789024257.420744:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789024257.420748:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789024257.420752:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789024257.420762:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 570 00000100:00080000:2.0:1789024257.420778:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789024257.420794:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024257.420821:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc199bed80 x1875927422393728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789024257.420903:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422393088:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421059:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422393600:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421086:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421115:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789024257.421121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422393472:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421186:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421210:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422394112:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421272:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422394240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024257.421311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421366:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422393216:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421415:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422393856:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421434:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421451:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789024257.421455:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422393344:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421488:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422393984:0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.421505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.421542:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024237/real 1789024237] req@ffff90cc3f9edc00 x1875927422384384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024257.421562:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9edc00 x1875927422384384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024257.421573:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789024237/real 1789024237] req@ffff90cc3f9eea00 x1875927422384512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024257 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024257.421583:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90cc3f9eea00 x1875927422384512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789024257 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024257.421597:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422393728:0@lo:8:kworker.0 00000100:00100000:2.0:1789024257.421653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789024257.421681:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789024257.421697:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789024257.421703:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393600 00000100:00100000:2.0:1789024257.421704:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422384384:0@lo:8:kworker.0 00000100:00080000:2.0:1789024257.421714:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1789024257.421719:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393600 00000100:00080000:2.0:1789024257.421724:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789024257.421730:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422384512:0@lo:8:kworker.0 00000100:00100000:2.0:1789024257.421772:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393088 00000100:00100000:2.0:1789024257.421779:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393088 00000100:00100000:0.0:1789024257.421798:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393728 00000100:00100000:0.0:1789024257.421804:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393728 00000100:00100000:2.0:1789024257.421835:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789024257.421842:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789024257.421850:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3644:x1875927422393088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024257.421864:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422393600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789024257.422480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024257.422487:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789024257.422491:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024257.422496:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:1.0:1789024257.422499:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1789024257.423687:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3644:x1875927422393088:12345-0@lo:400:kworker.0 Request processed in 1831us (2677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024257.423714:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422393600:12345-0@lo:400:kworker.0 Request processed in 1855us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024257.423727:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789024257.423762:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789024257.423768:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875927422393728:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789024257.423789:0:19173:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789024257.424128:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789024257.424233:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393472 00000100:00100000:2.0:1789024257.424258:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393472 00000100:00100000:2.0:1789024257.424300:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393216 00000100:00100000:2.0:1789024257.424303:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393216 00000100:00100000:2.0:1789024257.424317:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024257.424325:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422393472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.428513:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422393472:12345-0@lo:400:kworker.0 Request processed in 4174us (7312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.428532:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024257.428581:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789024257.428595:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422393216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.428661:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422393216:12345-0@lo:400:kworker.0 Request processed in 72us (7267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.428668:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789024257.428807:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394112 00000100:00100000:2.0:1789024257.428818:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394112 00000100:00100000:2.0:1789024257.428919:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393856 00000100:00100000:2.0:1789024257.428922:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393856 00000100:00100000:2.0:1789024257.428935:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393344 00000100:00100000:2.0:1789024257.428937:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393344 00000100:00100000:2.0:1789024257.428947:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422393984 00000100:00100000:2.0:1789024257.428950:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422393984 00000100:00100000:2.0:1789024257.428965:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789024257.428970:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422394112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.429005:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422394112:12345-0@lo:400:kworker.0 Request processed in 34us (7768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.429011:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789024257.429021:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789024257.429025:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.429071:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422393856:12345-0@lo:400:kworker.0 Request processed in 45us (7635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.429076:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789024257.429086:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789024257.429092:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422393344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.429114:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422393344:12345-0@lo:400:kworker.0 Request processed in 23us (7638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.429119:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789024257.429128:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789024257.429133:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024257.429181:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422393984:12345-0@lo:400:kworker.0 Request processed in 48us (7674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.429187:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789024257.429205:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394240 00000100:00100000:2.0:1789024257.429208:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394240 00000100:00100000:2.0:1789024257.429248:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789024257.429254:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422394240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024257.429282:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789024257.429315:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422394240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024257.429321:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789024257.440054:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90cc3bd3d800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024257.440160:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3be9c380 x1875927422394368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024257.440206:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789024257.440210:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789024257.440214:0:36:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789024257.440219:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 556 00000100:00080000:1.0:1789024257.440225:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789024257.440231:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:1.0:1789024257.440242:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3be9ea00 x1875927422394496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789024257.443692:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789024257.443708:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789024257.443713:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024257.447317:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875927422393728:12345-0@lo:8:kworker.0 Request processed in 23537us (25654us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789024257.447336:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789024257.449624:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422394368:0@lo:8:kworker.0 00000100:00100000:3.0:1789024257.449726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024257.449788:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422394496:0@lo:8:kworker.0 00000100:00100000:3.0:1789024257.449815:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789024257.449855:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024257.449861:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789024257.449865:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422393728:0@lo:8:kworker.0 00000100:00100000:3.0:1789024257.449921:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394368 00000100:00100000:3.0:1789024257.449929:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394368 00000100:00100000:3.0:1789024257.449961:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394496 00000100:00100000:3.0:1789024257.449964:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394496 00000100:00100000:3.0:1789024257.449979:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789024257.449986:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875927422394368:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789024257.450024:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:3.0:1789024257.450063:0:18654:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb4a0f 00002000:00100000:3.0:1789024257.450080:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90cb04004800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789024257.450084:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789024257.450087:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789024257.450200:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789024257.450235:0:18654:0:(import.c:65:import_set_state_nolock()) ffff90cb04001800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024257.450291:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422394368:12345-0@lo:8:kworker.0 Request processed in 303us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024257.450298:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789024257.450315:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789024257.450319:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875927422394496:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789024257.450331:0:18654:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789024257.450371:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875927422394496:12345-0@lo:8:kworker.0 Request processed in 50us (554us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789024257.450377:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789024257.450407:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3be9c380 x1875927422394368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789024282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450420:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024257.450428:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789024257.450444:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789024257.450450:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789024257.450453:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3bd3d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789024257.450476:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789024257.450481:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422394368:0@lo:8:kworker.0 00000100:00080000:3.0:1789024257.450491:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024257.450495:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789024257.450498:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422394496:0@lo:8:kworker.0 00010000:00080000:3.0:1789024257.450537:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf94e00 x1875927422394240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450554:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422394240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024257.450568:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422393472:0@lo:400:kworker.0 00010000:00080000:3.0:1789024257.450585:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bd180 x1875927422394112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422394112:0@lo:400:kworker.0 00000100:00100000:3.0:1789024257.450605:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422393088:0@lo:400:kworker.0 00010000:00080000:3.0:1789024257.450615:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bce00 x1875927422393600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422393600:0@lo:400:kworker.0 00010000:00080000:3.0:1789024257.450694:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bfb80 x1875927422393344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450704:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422393344:0@lo:400:kworker.0 00010000:00080000:3.0:1789024257.450730:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bca80 x1875927422393984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450739:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422393984:0@lo:400:kworker.0 00000100:00100000:3.0:1789024257.450751:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422393216:0@lo:400:kworker.0 00010000:00080000:3.0:1789024257.450761:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc199bc000 x1875927422393856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.450770:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422393856:0@lo:400:kworker.0 00000004:00080000:3.0:1789024257.450831:0:17168:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789024257.450849:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875927422394752:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789024257.450876:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024257.450892:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc3c029240 going to sleep for 11 seconds 00000100:00100000:3.0:1789024257.450902:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394752 00000100:00100000:3.0:1789024257.450906:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394752 00000100:00100000:3.0:1789024257.450938:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789024257.450944:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1875927422394752:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789024257.451219:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422394624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789024257.451246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024257.451298:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394624 00000100:00100000:3.0:1789024257.451302:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394624 00000100:00100000:3.0:1789024257.451323:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789024257.451329:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422394624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024257.451342:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024257.451394:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875927422394624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024257.451410:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789024257.451436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3f9ec000 x1875927422394624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024257.451449:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422394624:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789024257.461754:0:17167:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789024257.461883:0:17167:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 575497735786ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789024257.461893:0:17167:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1789024257.461929:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789024257.466345:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1789024257.472077:0:18654:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789024257.472095:0:18654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789024257.472102:0:18654:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:3.0:1789024257.510963:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.510985:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.511010:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.511016:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.511089:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.511114:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.511127:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.511135:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.511210:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789024257.511234:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.511244:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.511255:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.511262:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.511274:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.511299:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.511308:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071d7700a/0xa736ef4b98cb4a16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.511363:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.511365:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.511367:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024257.513916:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.513933:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.513960:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.513966:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.513973:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.513988:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.514001:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.514010:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.514039:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024257.514105:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024257.514115:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.514133:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024257.514139:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.514168:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.514194:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.514202:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4a1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.514222:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.514225:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.514227:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024257.515030:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.515039:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515050:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.515054:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.515059:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515069:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515090:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515099:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515195:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024257.515591:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.515597:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515617:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.515621:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.515626:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515636:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515645:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.515652:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515773:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024257.515782:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515791:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.515795:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515814:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515831:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515840:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001228eac3/0xa736ef4b98cb4a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515867:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.515871:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515877:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.515887:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515896:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515906:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.515913:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.515915:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.515917:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.516285:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024257.516291:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4a2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024257.516742:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.516749:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.516759:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.516763:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.516769:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.516780:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.516788:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.516796:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517005:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.517011:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517020:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338bc00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.517023:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517033:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517047:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517057:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.517065:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.517067:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.517130:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024257.517136:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6384e37/0xa736ef4b98cb4a32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024257.517537:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.517544:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.517553:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.517556:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.517561:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.517571:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.517579:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.517587:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517683:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.517689:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517746:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.517750:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517760:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517772:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.517781:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.517783:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.517785:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.518110:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024257.518115:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001536e9f8/0xa736ef4b98cb4a39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024257.518506:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.518513:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.518534:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.518538:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.518544:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.518555:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.518563:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.518572:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.518676:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.518682:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.518690:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.518694:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.518713:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.518731:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.518740:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.518742:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.518744:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.519086:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024257.519092:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e2e4ccc/0xa736ef4b98cb4a40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024257.519570:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024257.519576:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.519585:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1789024257.519589:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024257.519593:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.519626:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.519635:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.519643:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.519783:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.519789:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.519798:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ae00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.519803:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.519821:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.519835:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.519844:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.519846:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.519848:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.520690:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024257.520697:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2a415a/0xa736ef4b98cb4a47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.520847:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.522035:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.522045:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522067:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.522072:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.522078:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522091:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522101:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522110:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522220:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789024257.522595:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.522613:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522623:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.522626:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.522631:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522641:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522662:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.522670:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523210:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789024257.523220:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523231:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.523236:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523246:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523268:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523284:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a7878ab/0xa736ef4b98cb4a4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523303:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.523307:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523313:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.523317:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523325:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523335:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.523343:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.523345:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.523411:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.523512:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789024257.523518:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f03d40b/0xa736ef4b98cb4a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024257.524324:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.524334:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.524346:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.524364:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.524370:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.524382:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.524391:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.524410:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.524514:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.524522:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.524531:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.524540:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.524550:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.524565:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.524573:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.524574:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.524576:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.524710:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789024257.524716:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fae3c40d/0xa736ef4b98cb4a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024257.525265:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.525273:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.525283:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.525287:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.525291:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.525301:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.525310:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.525318:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.525549:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024257.525558:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.525566:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024257.525570:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.525580:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.525659:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.525724:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.525726:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.525728:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.525923:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789024257.525929:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4a63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789024257.529910:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.529927:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.529956:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.529961:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.529969:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.529986:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.529999:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.530008:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.530297:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.530307:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.530317:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.530322:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.530334:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.530367:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.530392:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.530394:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.530396:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.532575:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789024257.532591:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4a6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.532825:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.533650:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.533660:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.533678:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.533683:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.533691:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.536106:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.536129:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.536138:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.536186:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024257.536465:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024257.536474:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.536484:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024257.536490:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.536501:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.536523:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.536531:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ae61a9/0xa736ef4b98cb4a71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.536559:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.536561:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.536563:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.537322:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.537331:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.537345:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.537910:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.537924:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.538328:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.538343:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.538416:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.538441:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024257.538764:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.538774:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.538783:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.538788:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.538798:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.538873:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.538883:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009adaff49/0xa736ef4b98cb4a78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.538909:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.538911:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.538913:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.539328:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.539337:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.539410:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.539416:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.539422:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.539433:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.539443:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.539464:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.539515:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789024257.542137:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.542178:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.542199:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.542203:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.542211:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.542225:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.542237:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.542245:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.543335:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789024257.546034:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546071:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.546078:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546092:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546124:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546133:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdef493d/0xa736ef4b98cb4a7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546192:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.546198:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546206:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.546210:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546219:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546231:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.546246:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.546249:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.546253:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.547774:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789024257.547791:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d2efc2d/0xa736ef4b98cb4a86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024257.550167:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.550184:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.550204:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.550210:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.550217:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.550235:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.550246:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.550262:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.555374:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024257.555394:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.555435:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ee00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024257.555442:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.555457:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.555485:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.555500:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.555501:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.555504:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.556924:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789024257.556940:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f0387e1/0xa736ef4b98cb4a8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789024257.561730:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.561752:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.561774:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.561793:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.561800:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.561817:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.561829:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.561838:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.565408:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024257.565427:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.565445:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024257.565451:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.565464:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.565492:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024257.566513:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.566518:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024257.566521:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.571412:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789024257.571435:0:18654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086ecd682/0xa736ef4b98cb4a94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.571524:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789024257.572627:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.572638:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.572657:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.572662:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.572670:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.572686:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.572759:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.572769:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.572895:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789024257.573885:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.573960:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.573972:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.573976:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.573982:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.573993:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574003:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574010:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574079:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789024257.574879:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.574888:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574956:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.574961:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.574966:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574979:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.574997:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575003:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575498:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789024257.575521:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789024257.575530:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575541:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024257.575547:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575559:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575584:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575593:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc1cc48b/0xa736ef4b98cb4a9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575621:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024257.575633:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575640:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024257.575644:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575651:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575663:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575670:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a468f69b/0xa736ef4b98cb4aa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575684:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024257.575687:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575707:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252ea00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024257.575711:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575719:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575743:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575751:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ae85711/0xa736ef4b98cb4aa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.575765:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.575767:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.575769:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.576744:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.576875:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.577214:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.577227:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.577246:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.577251:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.577258:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.577271:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.577283:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.577291:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.577316:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024257.577403:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024257.577411:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.577421:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024257.577425:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.577433:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.577449:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.577457:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002469b7e6/0xa736ef4b98cb4ab0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.577487:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.577488:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024257.577490:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.577549:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789024257.578176:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789024257.578186:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578199:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=575s v=(0 0) 00010000:00010000:1.0:1789024257.578203:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024257.578214:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578227:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578237:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578245:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.578326:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789024257.578560:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.578566:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578576:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00031e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.578579:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578589:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578658:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578668:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bbefd7a/0xa736ef4b98cb4ab7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.578693:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.578695:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.578697:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789024257.579124:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.579130:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579141:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.579162:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.579168:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579181:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579189:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579197:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579218:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789024257.579225:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.579232:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.579242:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.579246:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.579255:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.579267:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.579276:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4b8035/0xa736ef4b98cb4abe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.579294:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.579296:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.579297:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789024257.579674:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.579680:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579716:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.579720:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.579724:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579734:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579741:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579749:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.579770:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789024257.580179:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024257.580188:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.580197:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024257.580200:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.580209:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.580235:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.580243:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ded767d4/0xa736ef4b98cb4ac5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024257.580266:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.580269:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024257.580271:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789024257.580304:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789024257.580311:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.580319:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=575s v=(0 0) 00010000:00010000:0.0:1789024257.580323:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024257.580327:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.580374:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.580394:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.580400:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024257.580415:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789024257.580448:0:18654:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00010000:00010000:1.0:1789024257.580481:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024257.580487:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.580506:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024257.580510:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.580520:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.580532:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.580541:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005482e4cd/0xa736ef4b98cb4acc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024257.580557:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.580559:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024257.580561:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024257.580571:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17168:x1875927422394752:12345-0@lo:5:osp-pre-0-0.0 Request processed in 129621us (129689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024257.580583:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789024257.580707:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875927422394752:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789024257.580727:0:17168:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789024257.580782:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875927422394880:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789024257.581267:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024257.581302:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc342b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789024257.584568:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422394880 00000100:00100000:0.0:1789024257.584590:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422394880 00000100:00100000:0.0:1789024257.584681:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024257.584709:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17168:x1875927422394880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789024257.584770:0:18651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1789024257.599384:0:18648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1789024257.599436:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789024257.599636:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17168:x1875927422394880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14940us (18364us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789024257.599649:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789024257.600299:0:17168:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789024257.600317:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17168:1875927422394880:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789024257.600339:0:17168:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:01000004:2.0:1789024258.420459:0:19466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789024258.420464:0:19466:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789024258.420466:0:19466:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789024258.421598:0:19466:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90cc0706e000 00000020:01000004:3.0:1789024258.421623:0:19466:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789024258.421641:0:19466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789024258.421668:0:19466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90cb0415cd40) 00000020:00000080:3.0:1789024258.421690:0:19466:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1789024258.445883:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422395008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024258.445980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024258.446070:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395008 00000100:00100000:1.0:1789024258.446080:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395008 00000100:00100000:1.0:1789024258.446134:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789024258.446143:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422395008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024258.446431:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024258.446480:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422395008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 338us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.446507:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789024258.447704:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422395008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024258.449660:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789024258.449683:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422395136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024258.449751:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.449802:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395136 00000100:00100000:2.0:1789024258.449810:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395136 00000100:00100000:2.0:1789024258.449853:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789024258.449862:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422395136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789024258.449896:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789024258.449955:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422395136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024258.449963:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789024258.450012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422395136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789024258.572396:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789024258.582684:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789024258.594138:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789024258.595658:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789024258.597490:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789024258.599509:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789024258.600972:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789024258.602780:0:19466:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1789024258.608491:0:19466:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789024258.609964:0:19466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789024258.609985:0:19466:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789024258.610002:0:19466:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa736ef4b98cb4ada 00000020:01000004:2.0:1789024258.610013:0:19466:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789024258.610039:0:19466:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.118@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789024258.610043:0:19466:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.118@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789024258.610050:0:19466:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789024258.610091:0:19466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789024258.610097:0:19466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.118@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789024258.640978:0:19466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.118@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789024258.641041:0:19466:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.118@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789024258.641046:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789024258.641048:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.641050:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.641051:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.641053:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.641055:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.641056:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.641058:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.641060:0:19466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789024258.641065:0:19466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789024258.641072:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789024258.641073:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.641074:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.641075:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.641076:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.641077:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.641078:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.641079:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.641080:0:19466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789024258.641116:0:19466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789024258.641141:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789024258.641292:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.641362:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789024258.641573:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395264 00000100:00100000:2.0:1789024258.641583:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395264 00000100:00100000:2.0:1789024258.641647:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789024258.641657:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:19466:x1875927422395264:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789024258.641717:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789024258.641720:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789024258.641725:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789024258.642464:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:19466:x1875927422395264:12345-0@lo:253:mount.lustre.0 Request processed in 807us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024258.642475:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789024258.642914:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395264:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789024258.642928:0:19466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789024258.642931:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789024258.642932:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.642933:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.642934:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.642936:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.642937:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.642939:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.642940:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.642941:0:19466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789024258.642964:0:19466:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90cc0706e000 from lustre-OST0001 10000000:01000000:0.0:1789024258.642998:0:19466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789024258.643001:0:19466:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789024258.643012:0:19466:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90cb020a8000 local copy 00010000:00010000:0.0:1789024258.643024:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024258.643164:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024258.643202:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.643245:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024258.643474:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395392 00000100:00100000:2.0:1789024258.643480:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395392 00000100:00100000:2.0:1789024258.643518:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789024258.643534:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:19466:x1875927422395392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024258.643607:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:19466:x1875927422395392:12345-0@lo:501:mount.lustre.0 Request processed in 82us (405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789024258.643621:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789024258.643818:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395392:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789024258.643831:0:19466:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.118@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789024258.643850:0:19466:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.118@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789024258.643856:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.643866:0:19466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc01323200/0xa736ef4b98cb4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4737 expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789024258.643892:0:19466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90cc0706e000 10000000:01000000:0.0:1789024258.643897:0:19466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789024258.643903:0:19466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789024258.643905:0:19466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789024258.643909:0:19466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789024258.643912:0:19466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789024258.643936:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.643945:0:19466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.643956:0:19466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024258.643968:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789024258.643993:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.644015:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789024258.644172:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395520 00000100:00100000:2.0:1789024258.644177:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395520 00000100:00100000:2.0:1789024258.644207:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789024258.644214:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:19466:x1875927422395520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024258.644235:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024258.644250:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb4ae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4ae1 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.644275:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb4ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4ae1 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.644286:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4200/0xa736ef4b98cb4ae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4ae1 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.644296:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4200, rc 0) 00000100:00100000:2.0:1789024258.644324:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395520:12345-0@lo:101:mount.lustre.0 Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024258.644330:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789024258.644631:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395520:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024258.644645:0:19466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ae8 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.644668:0:19466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4ae8 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024258.646142:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789024258.647005:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789024258.649072:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789024258.649130:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789024258.649142:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789024258.650021:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789024258.650206:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789024258.650234:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789024258.650265:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789024258.650272:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789024258.650414:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024258.650510:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.650575:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.650732:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395648 00000100:00100000:1.0:1789024258.650742:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395648 00000100:00100000:1.0:1789024258.650814:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789024258.650826:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024258.651010:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395648:12345-0@lo:501:mount.lustre.0 Request processed in 186us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.651018:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789024258.651423:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789024258.651459:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395776:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024258.651510:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.651601:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.651790:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395776 00000100:00100000:1.0:1789024258.651802:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395776 00000100:00100000:1.0:1789024258.651836:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789024258.651844:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789024258.653723:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395776:12345-0@lo:503:mount.lustre.0 Request processed in 1871us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.653739:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789024258.653865:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395776:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789024258.654569:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789024258.654667:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024258.654722:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.654758:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc347cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.654938:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422395904 00000100:00100000:1.0:1789024258.654946:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422395904 00000100:00100000:1.0:1789024258.654994:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789024258.655003:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024258.655901:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422395904:12345-0@lo:502:mount.lustre.0 Request processed in 896us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.655911:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789024258.656203:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422395904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024258.656483:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789024258.656513:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789024258.656538:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789024258.656552:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789024258.656564:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789024258.656575:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789024258.656592:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789024258.656608:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789024258.656628:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789024258.656660:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024258.656718:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.656752:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc342b86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.657006:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396032 00000100:00100000:1.0:1789024258.657018:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396032 00000100:00100000:1.0:1789024258.657141:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789024258.657188:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422396032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024258.657301:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422396032:12345-0@lo:502:mount.lustre.0 Request processed in 115us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.657309:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789024258.657486:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024258.657547:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789024258.657559:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789024258.663701:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789024258.663719:0:19470:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789024258.663735:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.663738:0:19470:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789024258.663746:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789024258.663775:0:19470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90cb040dcd40) 00000020:00000080:2.0:1789024258.663822:0:19470:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789024258.663829:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789024258.663930:0:19470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc0706e000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789024258.663940:0:19470:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789024258.663947:0:19470:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa736ef4b98cb4af6 00010000:00010000:2.0:1789024258.674568:0:19470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789024258.675861:0:19470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789024258.677752:0:19470:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789024258.679792:0:19470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789024258.679921:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024258.679930:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024258.679932:0:19470:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789024258.679936:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024258.679941:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024258.679943:0:19470:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789024258.679946:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789024258.679948:0:19470:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789024258.679951:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024258.679953:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024258.679954:0:19470:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789024258.679956:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789024258.679959:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024258.679960:0:19470:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789024258.679964:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789024258.679996:0:19470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789024258.679998:0:19470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789024258.679999:0:19470:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789024258.680003:0:19470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789024258.685469:0:19466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789024258.685540:0:19466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789024258.685564:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ae8 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.685581:0:19466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0252f200/0xa736ef4b98cb4ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ae8 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024258.685591:0:19466:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc0706e000 from 1 10000000:01000000:3.0:1789024258.685614:0:19466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789024258.685669:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.685678:0:19466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.685702:0:19466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024258.685734:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789024258.685831:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.689973:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.690033:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396160 00000100:00100000:1.0:1789024258.690045:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396160 00000100:00100000:1.0:1789024258.690116:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789024258.690127:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:19466:x1875927422396160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789024258.690173:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024258.690197:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4afd expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.690421:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.690437:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.690448:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030800, rc 0) 00000100:00100000:3.0:1789024258.690620:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789024258.690641:0:19466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.690651:0:19466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024258.692267:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789024258.692607:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789024258.693465:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789024258.693499:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789024258.693517:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789024258.693580:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789024258.693680:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024258.693851:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396160:12345-0@lo:101:mount.lustre.0 Request processed in 3722us (8017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.693863:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789024258.696604:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.696668:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789024258.696764:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396288 00000100:00100000:2.0:1789024258.696775:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396288 00000100:00100000:2.0:1789024258.696877:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789024258.696888:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024258.697062:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396288:12345-0@lo:501:mount.lustre.0 Request processed in 175us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024258.697070:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789024258.697283:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024258.697368:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024258.697411:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.699958:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789024258.700141:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396416 00000100:00100000:0.0:1789024258.700189:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396416 00000100:00100000:0.0:1789024258.700253:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789024258.700264:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024258.700443:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396416:12345-0@lo:503:mount.lustre.0 Request processed in 181us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.700452:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789024258.700818:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789024258.701664:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789024258.701759:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024258.701879:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.701922:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024258.702187:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396544 00000100:00100000:0.0:1789024258.702193:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396544 00000100:00100000:0.0:1789024258.702223:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789024258.702297:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024258.702412:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396544:12345-0@lo:502:mount.lustre.0 Request processed in 117us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.702426:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789024258.703330:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024258.703879:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789024258.703914:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789024258.703927:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789024258.703938:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789024258.703949:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789024258.703961:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789024258.703972:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789024258.703984:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789024258.704002:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789024258.704014:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789024258.704025:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789024258.704061:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024258.704123:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.704542:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.704666:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396672 00000100:00100000:1.0:1789024258.704673:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396672 00000100:00100000:0.0:1789024258.704873:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789024258.704885:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789024258.705019:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396672:12345-0@lo:502:mount.lustre.0 Request processed in 136us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.705027:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789024258.705116:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789024258.705202:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789024258.705214:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789024258.706784:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024258.706853:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.706857:0:19474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789024258.706866:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc0706e000 00000020:00000080:2.0:1789024258.706869:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789024258.706886:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024258.706888:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.706890:0:19474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789024258.706893:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024258.706895:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.706897:0:19474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789024258.706900:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90cc0706e000 00000020:00000080:2.0:1789024258.706902:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789024258.707011:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789024258.707015:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.707016:0:19474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789024258.707019:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789024258.707022:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789024258.707023:0:19474:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789024258.707027:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc0706e000 00000020:00000080:2.0:1789024258.707029:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789024258.709708:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024258.710887:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024258.710893:0:19474:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789024258.710903:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789024258.710909:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024258.710911:0:19474:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789024258.710916:0:19474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90cc0706e000 00000020:00000080:3.0:1789024258.710919:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789024258.711005:0:19474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789024258.711008:0:19474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789024258.711010:0:19474:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789024258.711013:0:19474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789024258.711186:0:19466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789024258.711241:0:19466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024258.711264:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.711280:0:19466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024258.711359:0:19466:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789024258.711363:0:19466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90cc0706e000 10000000:01000000:3.0:1789024258.711367:0:19466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90cc0706e000 10000000:01000000:3.0:1789024258.711371:0:19466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789024258.711378:0:19466:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90cc0706e000 from 1 10000000:01000000:3.0:1789024258.711382:0:19466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789024258.711426:0:19466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.711436:0:19466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.711449:0:19466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024258.711488:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789024258.711584:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.711638:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789024258.719921:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396800 00000100:00100000:0.0:1789024258.719941:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396800 00000100:00100000:0.0:1789024258.720015:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789024258.720026:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:19466:x1875927422396800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789024258.720048:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024258.720377:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252e000/0xa736ef4b98cb4b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4b0b expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.720413:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252e000/0xa736ef4b98cb4b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b0b expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.720426:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252e000/0xa736ef4b98cb4b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b0b expref: 24 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.720437:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252e000, rc 0) 00000100:00100000:0.0:1789024258.720606:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422396800:12345-0@lo:101:mount.lustre.0 Request processed in 581us (9021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.720614:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789024258.720859:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789024258.720884:0:19466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b12 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.720895:0:19466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4b12 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789024258.738977:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789024258.739418:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789024258.739980:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789024258.740007:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789024258.740020:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789024258.740031:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789024258.740043:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789024258.740054:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789024258.741969:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789024258.741983:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789024258.741995:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789024258.742007:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789024258.742036:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789024258.742050:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789024258.742611:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789024258.742640:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789024258.742653:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789024258.742665:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789024258.742678:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789024258.742700:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789024258.742714:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789024258.742726:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789024258.742738:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789024258.742750:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789024258.742762:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789024258.742775:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789024258.742787:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789024258.745006:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789024258.745141:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789024258.745175:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789024258.745187:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789024258.745199:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789024258.745210:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789024258.745222:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789024258.745233:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789024258.745245:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789024258.745257:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789024258.745270:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789024258.745283:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789024258.745295:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789024258.745307:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789024258.745327:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789024258.745350:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789024258.745365:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789024258.745388:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789024258.745401:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789024258.745413:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789024258.745424:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789024258.745451:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789024258.745457:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789024258.747975:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789024258.748066:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.748124:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02052840 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.749459:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422396928 00000100:00100000:1.0:1789024258.749475:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422396928 00000100:00100000:1.0:1789024258.749550:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789024258.749569:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422396928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789024258.749773:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422396928:12345-0@lo:501:mount.lustre.0 Request processed in 205us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.749781:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789024258.749898:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422396928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789024258.749956:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024258.750008:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.750041:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397056 00000100:00100000:0.0:1789024258.750046:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397056 00000100:00100000:3.0:1789024258.750055:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024258.750089:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789024258.750102:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397056:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789024258.750242:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789024258.750250:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397056:12345-0@lo:503:mount.lustre.0 Request processed in 144us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.750261:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000040:00080000:2.0:1789024258.752578:0:19466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789024258.752704:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024258.752786:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.752936:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb020526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024258.755254:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397184 00000100:00100000:3.0:1789024258.755274:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397184 00000100:00100000:3.0:1789024258.755349:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789024258.755361:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024258.757188:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397184:12345-0@lo:502:mount.lustre.0 Request processed in 1821us (4394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024258.757204:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789024258.757370:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024258.757888:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789024258.757930:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789024258.757949:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789024258.757963:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789024258.757978:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789024258.757989:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789024258.758002:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789024258.758014:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789024258.758043:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789024258.758058:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789024258.758141:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789024258.758196:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789024258.758211:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789024258.758235:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789024258.758248:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789024258.758262:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789024258.758277:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789024258.758289:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789024258.758301:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789024258.758313:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789024258.758326:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789024258.758424:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789024258.758442:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789024258.758457:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789024258.758486:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789024258.758501:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789024258.758515:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789024258.758592:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789024258.758612:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789024258.758627:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789024258.759127:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789024258.759207:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789024258.759227:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789024258.759242:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789024258.759262:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789024258.759279:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789024258.759292:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789024258.759308:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789024258.759322:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789024258.759347:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789024258.759375:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789024258.759390:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789024258.759401:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789024258.759413:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789024258.759425:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789024258.759441:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789024258.759459:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789024258.759471:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789024258.759766:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024258.759903:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.760002:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb020526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.760044:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397312 00000100:00100000:1.0:1789024258.760053:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397312 00000100:00100000:1.0:1789024258.760655:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789024258.760668:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789024258.760843:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397312:12345-0@lo:502:mount.lustre.0 Request processed in 177us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.760851:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789024258.761077:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024258.761328:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789024258.761367:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789024258.761401:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789024258.761444:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.761471:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb020526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024258.761634:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397440 00000100:00100000:3.0:1789024258.761640:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397440 00000100:00100000:3.0:1789024258.761682:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789024258.761698:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789024258.761785:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422397440:12345-0@lo:502:mount.lustre.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024258.761803:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789024258.761968:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422397440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789024258.762004:0:19466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789024258.762012:0:19466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789024258.763612:0:19479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789024258.763634:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90cb040db380) 00000020:00000080:2.0:1789024258.763664:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789024258.763802:0:19479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc0706e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789024258.763807:0:19479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc0706e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789024258.763810:0:19479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc0706e000 3 00010000:00080000:2.0:1789024258.763857:0:19479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb026e8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.118@tcp at head 00010000:00010000:2.0:1789024258.766751:0:19479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789024258.767126:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789024258.767202:0:19479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789024258.767218:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa736ef4b98cb4b20 00000100:00080000:2.0:1789024258.767230:0:19479:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789024258.767244:0:19479:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90cb026e8000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024258.767289:0:19479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb03a3ea00 x1875927422397568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789024258.767322:0:19479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789024258.768055:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422397568:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789024258.769493:0:19479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00080000:0.0:1789024258.769508:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:2.0:1789024258.769514:0:19479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90cb040d8000) 00000100:00080000:0.0:1789024258.769516:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789024258.769522:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789024258.769529:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 575 00000100:00080000:0.0:1789024258.769533:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789024258.769543:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024258.769565:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bf97800 x1875927422397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789024258.769599:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789024258.769602:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789024258.769604:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789024258.769608:0:12478:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 575 00000100:00080000:0.0:1789024258.769610:0:12478:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789024258.769615:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:0.0:1789024258.769624:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3bf94000 x1875927422398208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1789024258.769658:0:19479:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1789024258.769675:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422397696:0@lo:400:kworker.0 00000100:00100000:0.0:1789024258.769755:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.769790:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422398464:0@lo:400:kworker.0 00000100:00100000:0.0:1789024258.769814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.769844:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024258.769850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422398336:0@lo:400:kworker.0 00000020:01000004:2.0:1789024258.769868:0:19479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90cc0706e000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789024258.769873:0:19479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90cc0706e000 from lustre-OST0001, refs=3 00000100:00100000:0.0:1789024258.769879:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789024258.769881:0:19479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90cc0706e000 3 00000100:00100000:0.0:1789024258.769911:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422397952:0@lo:400:kworker.0 00010000:00080000:2.0:1789024258.769925:0:19479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90cb026ee000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.118@tcp at head 00000100:00100000:0.0:1789024258.769941:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.769958:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422398592:0@lo:400:kworker.0 00000100:00100000:0.0:1789024258.769976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.769986:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024258.769990:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422398080:0@lo:400:kworker.0 00000100:00100000:0.0:1789024258.770014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.770045:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397696 00000100:00100000:0.0:1789024258.770061:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397696 00000100:00100000:0.0:1789024258.770104:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398080 00000100:00100000:0.0:1789024258.770106:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398080 00000100:00100000:0.0:1789024258.770125:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789024258.770174:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024258.770222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.770250:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422397696:12345-0@lo:400:kworker.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.770259:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789024258.770267:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422397824:0@lo:8:kworker.0 00000100:00100000:0.0:1789024258.770280:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789024258.770289:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024258.770296:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.770310:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422398208:0@lo:8:kworker.0 00000100:00100000:0.0:1789024258.770333:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422398080:12345-0@lo:400:kworker.0 Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024258.770353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024258.770357:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789024258.770375:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397824 00000100:00100000:0.0:1789024258.770379:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397824 00000100:00100000:3.0:1789024258.770385:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398208 00000100:00100000:3.0:1789024258.770391:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398208 00000100:00100000:0.0:1789024258.770395:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024258.770407:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875927422397824:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789024258.770455:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875927422397824:12345-0@lo:8:kworker.0 Request processed in 47us (160us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789024258.772221:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398464 00000100:00100000:1.0:1789024258.772234:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398464 00000100:00100000:1.0:1789024258.772277:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398336 00000100:00100000:1.0:1789024258.772280:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398336 00000100:00100000:1.0:1789024258.772291:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397952 00000100:00100000:1.0:1789024258.772293:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397952 00000100:00100000:1.0:1789024258.772304:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398592 00000100:00100000:1.0:1789024258.772306:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398592 00000100:00100000:1.0:1789024258.772317:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422397568 00000100:00100000:1.0:1789024258.772320:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422397568 00000100:00100000:1.0:1789024258.772332:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789024258.772355:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024258.772432:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422398464:12345-0@lo:400:kworker.0 Request processed in 80us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.772440:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789024258.772455:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789024258.772460:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024258.772493:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875927422398336:12345-0@lo:400:kworker.0 Request processed in 33us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.772500:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789024258.772510:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789024258.772514:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024258.772601:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422397952:12345-0@lo:400:kworker.0 Request processed in 86us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.772608:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789024258.772619:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789024258.772624:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422398592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024258.772648:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422398592:12345-0@lo:400:kworker.0 Request processed in 24us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.772653:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789024258.772662:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789024258.772666:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422397568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789024258.772762:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:1.0:1789024258.772865:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa736ef4b98cb4b2e 00000004:00100000:1.0:1789024258.772883:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789024258.772925:0:17143:0:(import.c:65:import_set_state_nolock()) ffff90cc3bf98800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789024258.772962:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875927422397568:12345-0@lo:38:llog_process_th.0 Request processed in 294us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.772969:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789024258.774224:0:19479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1789024258.774880:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789024258.774898:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789024258.774909:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422398208:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789024258.774974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf94380 x1875927422398336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024258.774993:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875927422398336:0@lo:400:kworker.0 00000100:00100000:3.0:1789024258.775004:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422398208:12345-0@lo:8:kworker.0 Request processed in 94us (4653us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789024258.775012:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024258.775015:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422397696:0@lo:400:kworker.0 00010000:00080000:0.0:1789024258.775031:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf97480 x1875927422398464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024258.775042:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422398464:0@lo:400:kworker.0 00000020:00000080:2.0:1789024258.775141:0:19479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789024258.775236:0:19479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789024258.775249:0:19479:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa736ef4b98cb4b35 00000100:00080000:2.0:1789024258.775258:0:19479:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789024258.775268:0:19479:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90cb026ee000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:2.0:1789024258.775302:0:19479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cb03a3f800 x1875927422398720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789024258.775320:0:19479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789024258.777502:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422398720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789024258.778936:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.780409:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024258.780422:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024258.780429:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789024258.780434:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422397824:0@lo:8:kworker.0 00000100:00100000:3.0:1789024258.780451:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024258.780454:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789024258.780458:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789024258.780462:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422398208:0@lo:8:kworker.0 00010000:00080000:3.0:1789024258.780482:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03a3ea00 x1875927422397568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024258.780495:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1789024258.780495:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422398080:0@lo:400:kworker.0 00010000:00080000:0.0:1789024258.780514:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf97b80 x1875927422397952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789024258.780523:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:0.0:1789024258.780527:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422397952:0@lo:400:kworker.0 00000100:00080000:3.0:1789024258.780538:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00080000:0.0:1789024258.780544:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cc3bf94e00 x1875927422398592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789024258.780547:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789024258.780553:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb026e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789024258.780558:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422398592:0@lo:400:kworker.0 00000100:00100000:3.0:1789024258.780564:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875927422397568:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789024258.782420:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789024258.782531:0:19466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789024258.782564:0:19466:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789024258.782592:0:19466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b12 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024258.782626:0:19466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338b400/0xa736ef4b98cb4b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b12 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789024258.782690:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789024258.782692:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.782694:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.782696:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.782698:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.782699:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.782701:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.782703:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.782704:0:19466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789024258.782709:0:19466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789024258.782712:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789024258.782713:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.782714:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.782715:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.782716:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.782717:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.782718:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.782719:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.782721:0:19466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789024258.782751:0:19466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789024258.782774:0:19466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422398848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789024258.782854:0:19466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.782887:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398848 00000100:00100000:3.0:1789024258.782897:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398848 00000100:00100000:0.0:1789024258.782898:0:19466:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc18d43840 going to sleep for 11 seconds 00000100:00100000:3.0:1789024258.782961:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789024258.782971:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422398848:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789024258.783004:0:17137:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789024258.783022:0:17137:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789024258.785311:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398720 00000100:00100000:1.0:1789024258.785327:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398720 00000100:00100000:0.0:1789024258.785456:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789024258.785465:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875927422398720:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789024258.785502:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1789024258.785550:0:17143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa736ef4b98cb4b3c 00000004:00100000:0.0:1789024258.785571:0:17143:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789024258.785614:0:17143:0:(import.c:65:import_set_state_nolock()) ffff90cc18898800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024258.785725:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875927422398720:12345-0@lo:38:llog_process_th.0 Request processed in 259us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.785733:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789024258.785806:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90cb03a3f800 x1875927422398720/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789024268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024258.785820:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789024258.785829:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789024258.785838:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789024258.785843:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789024258.785846:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cb026ee000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789024258.785852:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875927422398720:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1789024258.789932:0:17137:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789024258.789984:0:17137:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789024258.790518:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:19466:x1875927422398848:12345-0@lo:253:mount.lustre.0 Request processed in 7541us (7657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024258.790539:0:19466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:19466:1875927422398848:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789024258.790554:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 10000000:01000000:0.0:1789024258.790559:0:19466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789024258.790564:0:19466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789024258.790566:0:19466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789024258.790568:0:19466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789024258.790570:0:19466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789024258.790572:0:19466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789024258.790573:0:19466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789024258.790576:0:19466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789024258.790578:0:19466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789024258.790580:0:19466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789024258.790600:0:19466:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789024258.791307:0:17159:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789024258.791315:0:17159:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789024258.791352:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791371:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791379:0:17159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791398:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791440:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791455:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 23 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024258.791470:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422398976:0@lo:104: 00000100:00100000:2.0:1789024258.791516:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789024258.791660:0:17159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024258.791668:0:17159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024258.791678:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422399104:0@lo:104: 00000100:00100000:2.0:1789024258.791762:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024258.791875:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02052840 going to sleep for 11 seconds 00000100:00100000:1.0:1789024258.791929:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422398976 00000100:00100000:1.0:1789024258.791937:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422398976 00000100:00100000:1.0:1789024258.791978:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399104 00000100:00100000:1.0:1789024258.791980:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399104 00000100:00100000:1.0:1789024258.791993:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789024258.792001:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422398976:12345-0@lo:104: 00010000:00010000:1.0:1789024258.792017:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.795726:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789024258.795747:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:17159:x1875927422398976:12345-0@lo:104: Request processed in 3741us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.795761:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789024258.795814:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789024258.795828:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422399104:12345-0@lo:104: 00010000:00010000:1.0:1789024258.795847:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.795923:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789024258.795928:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:17159:x1875927422399104:12345-0@lo:104: Request processed in 106us (4167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.795933:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789024258.795952:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024258.795959:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.795968:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5c00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024258.795981:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.795991:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024258.796000:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024258.796006:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789024258.796061:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796073:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024258.796099:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796106:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5c00/0xa736ef4b98cb49fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4a01 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796121:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024258.796124:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796131:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024258.796134:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796141:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024258.796175:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024258.796181:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789024258.796194:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796199:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024258.796213:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796221:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0338a800/0xa736ef4b98cb49ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49f3 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.796246:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024258.796247:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024258.796249:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024258.796256:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024258.797657:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024258.797681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422399232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024258.797746:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024258.799912:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422398976:0@lo:104: 00000100:00100000:3.0:1789024258.799931:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17159:1875927422399104:0@lo:104: 00010000:00010000:3.0:1789024258.799965:0:17159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024258.800358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3643:1875927422399360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024258.800426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024258.801377:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399232 00000100:00100000:1.0:1789024258.801389:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399232 00010000:00010000:1.0:1789024258.801434:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 24 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024258.801467:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399360 00000100:00100000:1.0:1789024258.801470:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399360 00010000:00010000:1.0:1789024258.801482:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 25 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024258.801612:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789024258.801626:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+25:3641:x1875927422399232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789024258.801645:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024258.801653:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 25 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801668:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 25 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801689:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa4400/0xa736ef4b98cb4a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb49fa expref: 25 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801705:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024258.801766:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422399232:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.801775:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789024258.801856:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789024258.801865:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:3643:x1875927422399360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789024258.801875:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024258.801880:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801892:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801906:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01323e00/0xa736ef4b98cb49f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb49ec expref: 23 pid: 17137 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801929:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801940:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789024258.801959:0:17128:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641837s 00010000:00010000:1.0:1789024258.801965:0:17128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801974:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801982:0:17128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801990:0:17128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.801998:0:17128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024258.802004:0:17128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.802015:0:17128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.802035:0:17128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024258.802175:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024258.802222:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:3643:x1875927422399360:12345-0@lo:103:ldlm_bl.0 Request processed in 357us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024258.802292:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789024258.802379:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3643:1875927422399360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789024258.802412:0:17159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.802421:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024258.802429:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc22fa5400/0xa736ef4b98cb4b43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024258.802598:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422399232:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789024258.808018:0:19466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789024258.812997:0:19466:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789024258.813010:0:19466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789024258.813076:0:19466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789024258.813133:0:19466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.118@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789024258.813213:0:19466:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789024258.813262:0:19466:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789024258.816134:0:19466:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789024258.816620:0:19466:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789024259.214765:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789024259.597454:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789024259.826282:0:19532:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789024259.828380:0:19532:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789024260.108238:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789024260.108246:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb03356800 from 10 10000000:01000000:3.0:1789024260.108253:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789024260.108302:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024260.108315:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024260.108360:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024260.108414:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789024260.108486:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024260.108535:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc342b8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789024260.108706:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399488 00000100:00100000:1.0:1789024260.108715:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399488 00000100:00100000:1.0:1789024260.108775:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024260.108784:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422399488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024260.108797:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024260.108812:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031000/0xa736ef4b98cb4b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4b4a expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.108834:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031000/0xa736ef4b98cb4b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b4a expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.108844:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031000/0xa736ef4b98cb4b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b4a expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.108853:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031000, rc 0) 00000100:00100000:1.0:1789024260.108896:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422399488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024260.108902:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789024260.108945:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024260.108960:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b51 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.108981:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4b51 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024260.109031:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789024260.109063:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024260.109079:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024260.109092:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399616 00000100:00100000:1.0:1789024260.109096:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399616 00000100:00100000:1.0:1789024260.109118:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024260.109123:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422399616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789024260.109137:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789024260.109172:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789024260.109176:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789024260.109248:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422399616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024260.109256:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789024260.109283:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789024260.109349:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789024260.109355:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b51 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109363:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cb0338bc00/0xa736ef4b98cb4b4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b51 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024260.109372:0:17140:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789024260.109374:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90cb0401f000 from 10 10000000:01000000:1.0:1789024260.109380:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789024260.109407:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109414:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109422:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024260.109434:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024260.109458:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024260.109471:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024260.109482:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399744 00000100:00100000:1.0:1789024260.109486:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399744 00000100:00100000:1.0:1789024260.109505:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789024260.109511:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422399744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024260.109517:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024260.109523:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb4b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4b58 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109537:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb4b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b58 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109544:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030e00/0xa736ef4b98cb4b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4b58 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109550:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030e00, rc 0) 00000100:00100000:1.0:1789024260.109576:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422399744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024260.109589:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789024260.109618:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024260.109629:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b5f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.109636:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4b5f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024260.109668:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789024260.109702:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024260.109958:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc4141c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789024260.109971:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422399872 00000100:00100000:1.0:1789024260.109974:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422399872 00000100:00100000:1.0:1789024260.109996:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024260.110002:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422399872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789024260.110011:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789024260.110021:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789024260.110024:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789024260.110082:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422399872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 80us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024260.110089:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789024260.110116:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422399872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789024260.110173:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789024260.110178:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b5f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.110194:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00031e00/0xa736ef4b98cb4b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4b5f expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024260.622800:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024261.644286:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024262.541333:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024262.541353:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422400000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024262.541524:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422400128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024262.541782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024262.541901:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024262.541975:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400000 00000100:00100000:2.0:1789024262.541984:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400000 00000100:00100000:2.0:1789024262.542041:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400128 00000100:00100000:2.0:1789024262.542045:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400128 00000100:00100000:2.0:1789024262.542065:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789024262.542074:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422400000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024262.542101:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789024262.542174:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422400000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024262.542180:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789024262.542192:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789024262.542196:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422400128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024262.542203:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789024262.542220:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422400128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024262.542224:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789024262.542252:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422400128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024262.542273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422400000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789024262.542436:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789024262.669422:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024263.564599:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024263.564624:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024263.564698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024263.564760:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400256 00000100:00100000:1.0:1789024263.564767:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400256 00000100:00100000:1.0:1789024263.564818:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789024263.564827:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789024263.564860:0:18205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024263.564906:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024263.564913:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789024263.564962:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024263.565505:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422400384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024263.565541:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024263.565764:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400384 00000100:00100000:1.0:1789024263.565770:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400384 00000100:00100000:1.0:1789024263.565810:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789024263.565817:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422400384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789024263.565840:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024263.565899:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422400384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024263.565904:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789024263.566142:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422400384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789024263.693637:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789024264.079489:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024264.079497:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789024264.079500:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024264.079517:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90cc054f2800 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024264.079539:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc3f9eed80 x1875927422400896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789024264.079574:0:12478:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789024264.079577:0:12478:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789024264.079579:0:12478:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789024264.079584:0:12478:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90cc3538c000 using connection 192.168.202.118@tcp/0@lo 00000100:00100000:3.0:1789024264.079594:0:12478:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90cc199bca80 x1875927422401408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789024264.079646:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422400512:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.079722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.079763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422401152:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.079789:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.079809:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422401792:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.079843:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.079869:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789024264.079876:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422401024:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.079896:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.079913:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422401664:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080323:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080356:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400640:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080399:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422401280:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080436:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422401920:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080468:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789024264.080474:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400768:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080510:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422401536:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080530:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080541:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422402048:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080557:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080579:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422400896:0@lo:8:kworker.0 00000100:00100000:3.0:1789024264.080600:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080618:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422401408:0@lo:8:kworker.0 00000100:00100000:3.0:1789024264.080637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024264.080669:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400512 00000100:00100000:3.0:1789024264.080682:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400512 00000100:00100000:3.0:1789024264.080728:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789024264.080736:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3644:x1875927422400512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080781:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3644:x1875927422400512:12345-0@lo:400:kworker.0 Request processed in 45us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.080787:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789024264.080818:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401152 00000100:00100000:3.0:1789024264.080821:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401152 00000100:00100000:3.0:1789024264.080841:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400640 00000100:00100000:3.0:1789024264.080844:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400640 00000100:00100000:3.0:1789024264.080857:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789024264.080862:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422401152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.080893:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422401152:12345-0@lo:400:kworker.0 Request processed in 31us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.080898:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789024264.080909:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789024264.080914:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081184:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401792 00000100:00100000:2.0:1789024264.081190:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401792 00000100:00100000:2.0:1789024264.081222:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401024 00000100:00100000:2.0:1789024264.081225:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401024 00000100:00100000:2.0:1789024264.081235:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401664 00000100:00100000:2.0:1789024264.081237:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401664 00000100:00100000:2.0:1789024264.081248:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401920 00000100:00100000:2.0:1789024264.081251:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401920 00000100:00100000:2.0:1789024264.081263:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401536 00000100:00100000:2.0:1789024264.081266:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401536 00000100:00100000:2.0:1789024264.081276:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402048 00000100:00100000:2.0:1789024264.081279:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402048 00000100:00100000:2.0:1789024264.081305:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789024264.081319:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422401792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081352:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422401792:12345-0@lo:400:kworker.0 Request processed in 35us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081358:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789024264.081372:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789024264.081377:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422401024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081402:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875927422401024:12345-0@lo:400:kworker.0 Request processed in 26us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081408:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789024264.081419:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789024264.081425:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422401664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081450:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875927422401664:12345-0@lo:400:kworker.0 Request processed in 25us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081455:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789024264.081467:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789024264.081472:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081504:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422401920:12345-0@lo:400:kworker.0 Request processed in 32us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081509:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789024264.081519:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789024264.081525:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422401536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081548:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422401536:12345-0@lo:400:kworker.0 Request processed in 24us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081554:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789024264.081564:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789024264.081575:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422402048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024264.081603:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422402048:12345-0@lo:400:kworker.0 Request processed in 28us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.081608:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789024264.081626:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024264.081630:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024264.081695:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400640:12345-0@lo:400:kworker.0 Request processed in 781us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.081701:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789024264.081718:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401280 00000100:00100000:3.0:1789024264.081721:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401280 00000100:00100000:3.0:1789024264.081755:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400768 00000100:00100000:3.0:1789024264.081758:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400768 00000100:00100000:3.0:1789024264.081768:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422400896 00000100:00100000:3.0:1789024264.081770:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422400896 00000100:00100000:3.0:1789024264.081778:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422401408 00000100:00100000:3.0:1789024264.081780:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422401408 00000100:00100000:3.0:1789024264.081789:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789024264.081802:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422401280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.081833:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422401280:12345-0@lo:400:kworker.0 Request processed in 32us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.081839:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789024264.081850:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789024264.081855:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.081881:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422400768:12345-0@lo:400:kworker.0 Request processed in 26us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.081886:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789024264.081896:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789024264.081900:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422400896:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1789024264.082418:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789024264.082455:0:18651:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:3.0:1789024264.082488:0:18651:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa736ef4b98cb4b66 00002000:00100000:3.0:1789024264.082501:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90cb01afd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789024264.082504:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789024264.082507:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789024264.082674:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789024264.082697:0:18651:0:(import.c:65:import_set_state_nolock()) ffff90cb01af8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024264.082753:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875927422400896:12345-0@lo:8:kworker.0 Request processed in 851us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.082761:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789024264.082775:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789024264.082779:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875927422401408:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789024264.082812:0:18651:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:3.0:1789024264.082829:0:18651:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa736ef4b98cb4b6d 00002000:00100000:3.0:1789024264.082840:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90cb01af9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789024264.082843:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789024264.082845:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789024264.082868:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789024264.082881:0:18651:0:(import.c:65:import_set_state_nolock()) ffff90cb01afb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024264.082909:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875927422401408:12345-0@lo:8:kworker.0 Request processed in 128us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.082915:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789024264.083453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9eed80 x1875927422400896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789024289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789024264.083469:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789024264.083477:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789024264.083483:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789024264.083485:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc054f2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789024264.083506:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789024264.083512:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875927422400896:0@lo:8:kworker.0 00010000:00080000:2.0:1789024264.083527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bca80 x1875927422401408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789024289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789024264.083536:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789024264.083541:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789024264.083544:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789024264.083546:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90cc3538c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789024264.083559:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789024264.083563:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875927422401408:0@lo:8:kworker.0 00000004:00080000:2.0:1789024264.083593:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789024264.083656:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 582119508673ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789024264.083662:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789024264.085547:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789024264.087751:0:17887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789024264.087796:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402304:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789024264.087865:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024264.087897:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422402176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024264.087910:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024264.087978:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024264.088046:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402176 00000100:00100000:2.0:1789024264.088055:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402176 00000100:00100000:2.0:1789024264.088124:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789024264.088135:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875927422402176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024264.088191:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789024264.088239:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875927422402176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.088247:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789024264.088280:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789024264.088335:0:17886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789024264.088427:0:17886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 582124280390ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789024264.088434:0:17886:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1789024264.088492:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7d880 x1875927422402176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024264.088520:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422402176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024264.088671:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400768:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088689:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bfb80 x1875927422401536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088700:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422401536:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088713:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bdf80 x1875927422402048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088720:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422402048:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.088731:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422400640:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.088740:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422401280:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088759:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bd180 x1875927422401920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088767:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422401920:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088810:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ec700 x1875927422401024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088820:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875927422401024:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088830:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bce00 x1875927422401664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088837:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875927422401664:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.088846:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422400512:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.088856:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422401152:0@lo:400:kworker.0 00010000:00080000:3.0:1789024264.088865:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bea00 x1875927422401792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024264.088873:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422401792:0@lo:400:kworker.0 00000100:00100000:3.0:1789024264.088899:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402304 00000100:00100000:3.0:1789024264.088904:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402304 00000004:00080000:0.0:1789024264.090340:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789024264.090364:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875927422402560:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789024264.090424:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024264.090450:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc191e2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789024264.090467:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402560 00000100:00100000:0.0:1789024264.090474:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402560 00000100:00100000:0.0:1789024264.090530:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789024264.090539:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17170:x1875927422402560:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789024264.093038:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024264.093060:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789024264.093092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422402432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789024264.093212:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024264.093525:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402432 00000100:00100000:2.0:1789024264.093535:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402432 00000100:00100000:2.0:1789024264.093616:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789024264.093627:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422402432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789024264.093662:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789024264.093717:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875927422402432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024264.093724:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789024264.093797:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03beca80 x1875927422402432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789024280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024264.093824:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422402432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024264.094612:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789024264.094633:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1875927422402304:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:3.0:1789024264.096507:0:18651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789024264.096516:0:18651:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789024264.096674:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1875927422402304:12345-0@lo:7:osp-pre-1-1.0 Request processed in 2046us (8805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.096687:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789024264.099369:0:17876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789024264.099709:0:19173:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789024264.099718:0:19173:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789024264.099724:0:19173:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:1.0:1789024264.107632:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fa7d500 x1875927422402304/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789024280 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024264.107664:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402304:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789024264.107684:0:17887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1789024264.107736:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402688:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789024264.107795:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024264.107835:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc2c269900 going to sleep for 11 seconds 00000100:00100000:1.0:1789024264.107878:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402688 00000100:00100000:1.0:1789024264.107885:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402688 00000100:00100000:1.0:1789024264.108238:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789024264.108250:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17887:x1875927422402688:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789024264.108294:0:18654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789024264.108351:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17887:x1875927422402688:12345-0@lo:5:osp-pre-1-1.0 Request processed in 102us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024264.108357:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789024264.108440:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3be9e680 x1875927422402688/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789024280 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024264.108452:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402688:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789024264.108460:0:17887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789024264.108487:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402816:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789024264.108513:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024264.108541:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb010ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1789024264.112622:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402816 00000100:00100000:1.0:1789024264.112651:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402816 00000100:00100000:1.0:1789024264.112733:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789024264.112743:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17887:x1875927422402816:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789024264.112790:0:18651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789024264.125691:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.125705:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.125725:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.125730:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.125737:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.125756:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.125767:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.125775:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.125793:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.126426:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.126433:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126442:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.126451:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.126456:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126466:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126474:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126480:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126501:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789024264.126515:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789024264.126521:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126529:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024264.126533:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126542:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126556:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126574:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126592:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024264.126595:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126601:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024264.126604:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126611:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126620:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.126626:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.128885:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.131804:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.131811:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.131814:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.136374:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.136387:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.136410:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.136415:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.136421:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.136435:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.136447:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.136454:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.137248:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.141028:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.141046:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.141066:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.141071:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.141077:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.141091:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.141114:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.141122:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.146647:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024264.146661:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.146686:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.146690:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.146701:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.146724:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.146733:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4b82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.147762:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.147770:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.147780:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.147791:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.147800:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.147816:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.147825:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.147826:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.147829:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.152231:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.152244:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4b89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.152912:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.153231:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.153240:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.153253:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.153257:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.153263:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.153276:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.153295:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.153313:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.153332:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789024264.155488:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024264.155500:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.155512:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.155517:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.155527:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.155563:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.155570:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4b90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.155593:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.155595:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.155597:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.156432:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.156442:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.156455:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.156459:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.156465:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.156477:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.156487:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.156495:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.156550:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.158605:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.158617:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.158701:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.158707:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.158714:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.158730:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.158741:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.158748:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158843:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024264.158854:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158863:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.158868:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158877:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158893:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158901:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4b97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158949:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024264.158953:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158959:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.158963:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158971:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158982:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.158989:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.158990:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.158992:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.164154:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.164167:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4b9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.167331:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.167346:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.167363:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.167368:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.167374:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.167400:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.167412:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.167420:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.169974:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024264.169990:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.170728:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.170734:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.170762:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.170785:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.170795:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.170797:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.170799:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789024264.172064:0:19467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789024264.172084:0:19467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789024264.172088:0:19467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789024264.172256:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17887:x1875927422402816:12345-0@lo:5:osp-pre-1-1.0 Request processed in 59509us (63738us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789024264.172267:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789024264.172329:0:17887:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789024264.172336:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17887:1875927422402816:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789024264.172352:0:17887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789024264.172404:0:17887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875927422402944:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789024264.172440:0:17887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024264.172463:0:17887:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc191e2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789024264.172488:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422402944 00000100:00100000:0.0:1789024264.172494:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422402944 00000100:00100000:0.0:1789024264.172531:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789024264.172552:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875927422402944:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789024264.172599:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875927422402944:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024264.172605:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789024264.172647:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cb03bee680 x1875927422402944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789024280 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024264.172658:0:17887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875927422402944:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789024264.173082:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.173092:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4ba5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.173491:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.173716:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.173724:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.173739:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.173743:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.173750:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.173764:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.173785:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.173792:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.173816:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.173947:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.173954:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.173963:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.173967:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.173977:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.173995:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174015:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e12f881/0xa736ef4b98cb4bac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174033:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.174040:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.174042:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.174593:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.174601:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.174610:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.174613:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.174617:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.174625:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.174633:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.174651:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.174686:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.174827:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.174833:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174842:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.174846:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174854:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174866:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174873:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d782f57/0xa736ef4b98cb4bb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.174889:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.174890:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.174891:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.175302:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.175308:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175316:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.175319:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.175323:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175332:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175338:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175345:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175365:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.175486:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.175491:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.175499:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.175502:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.175515:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.175527:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.175534:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2f4aecc/0xa736ef4b98cb4bba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.175547:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.175549:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.175550:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.175913:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.175920:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175928:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.175937:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.175941:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175951:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175959:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175966:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.175986:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.176091:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.176097:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.176105:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.176108:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.176117:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.176128:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.176174:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4bc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.176190:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.176192:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.176194:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.176573:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.176579:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.176588:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.176591:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.176595:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.176604:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.176613:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.176626:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.176730:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.177321:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.177327:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.177337:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.177340:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.177344:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.177353:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.177360:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.177366:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181682:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024264.181700:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181715:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338be00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.181719:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181730:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181752:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181759:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3f63ec/0xa736ef4b98cb4bc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181790:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.181794:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181812:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.181815:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181822:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181832:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.181839:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.181841:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.181842:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.182075:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.182130:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.182139:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032af1b0a/0xa736ef4b98cb4bcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.183017:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.183025:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183038:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.183042:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.183050:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183064:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183072:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183079:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183093:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.183574:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.183581:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.183589:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338a400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.183593:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.183602:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.183616:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.183632:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001228eac3/0xa736ef4b98cb4bd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.183662:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.183664:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.183666:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.183794:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.183800:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183808:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.183811:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.183821:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183831:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183838:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183845:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.183865:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.184226:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.184232:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184240:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338b200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.184244:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184252:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184263:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184271:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001536e9f8/0xa736ef4b98cb4bdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184297:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.184299:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.184301:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.184405:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.184411:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184419:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.184422:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.184426:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184435:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184443:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184461:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184480:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.184744:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.184749:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184757:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.184761:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184770:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184781:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184788:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132bb458/0xa736ef4b98cb4be4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.184803:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.184804:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.184806:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.184884:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.184889:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184898:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.184901:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.184905:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184913:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184921:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.184941:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.185309:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.185649:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.185655:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.185670:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.185674:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.185677:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.185687:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.185695:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.185702:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188483:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024264.188499:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188514:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.188519:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188547:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188569:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188578:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a710afb8/0xa736ef4b98cb4beb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188629:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.188634:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188651:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.188655:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188663:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188674:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.188681:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.188683:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.188690:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.190195:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.190207:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4bf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.191675:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.191686:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.191701:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.191705:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.191711:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.191738:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.191750:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.191758:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.195813:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.195830:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.195845:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.195851:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.195863:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.195884:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.196746:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.196750:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.196752:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.197364:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.197374:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4bf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.197963:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.197971:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.197988:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.197993:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.197999:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198026:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198049:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198057:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198073:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.198472:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.198478:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.198487:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160a00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.198491:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.198500:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.198528:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.198535:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c274c4bc/0xa736ef4b98cb4c00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.198552:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.198554:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.198556:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.198562:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.198652:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.198658:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198667:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.198670:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.198674:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198684:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198691:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198698:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.198733:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.199011:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.199017:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199025:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.199029:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199037:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199048:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199055:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003455783e/0xa736ef4b98cb4c07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199078:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.199080:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.199082:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.199195:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.199201:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.199209:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.199212:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.199216:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.199225:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.199232:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.199240:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.199250:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789024264.199451:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.199456:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199464:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.199467:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199475:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199486:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199494:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e078583e/0xa736ef4b98cb4c0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.199508:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.199510:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.199511:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789024264.200460:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.200469:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.200479:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.200488:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.200494:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.200505:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.200515:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.200522:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.200704:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.201060:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.201066:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.201075:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.201078:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.201083:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.201093:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.201101:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.201113:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204524:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789024264.204542:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204573:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160200 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.204578:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204589:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204609:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204616:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f845e7/0xa736ef4b98cb4c15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204650:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789024264.204654:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204661:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161e00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024264.204665:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204672:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204683:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024264.204697:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.204699:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.204701:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.205863:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.205874:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002606e2b/0xa736ef4b98cb4c1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.206501:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.206509:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.206523:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.206528:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.206534:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.206546:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.206556:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.206563:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.206632:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789024264.207803:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.207811:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.207823:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.207827:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.207831:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.207842:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.207850:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.207858:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207902:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024264.207909:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207918:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161400 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.207923:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207932:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207950:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207957:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000312e1a09/0xa736ef4b98cb4c23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207986:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024264.207989:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.207996:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161c00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024264.207999:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.208007:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.208016:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024264.208022:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.208023:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024264.208025:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024264.213164:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.213266:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789024264.213277:0:19173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2044c92/0xa736ef4b98cb4c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789024264.213987:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789024264.213996:0:19173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214018:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1789024264.214022:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024264.214029:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214043:0:19173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214054:0:19173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214060:0:19173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214086:0:19173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789024264.214098:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789024264.214103:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214112:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:3.0:1789024264.214117:0:18299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214126:0:18299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214184:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214192:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786bbbd4/0xa736ef4b98cb4c31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024264.214206:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.214208:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024264.214209:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789024264.214254:0:19173:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1789024264.214358:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17170:x1875927422402560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 123817us (123931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024264.214368:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789024264.214735:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024264.215272:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875927422402560:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789024264.215301:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789024264.215350:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875927422403072:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789024264.215390:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024264.216272:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb010ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1789024264.217701:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403072 00000100:00100000:0.0:1789024264.217715:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403072 00000100:00100000:0.0:1789024264.217780:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789024264.217790:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17170:x1875927422403072:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789024264.217842:0:18653:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1789024264.224169:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17170:x1875927422403072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6374us (8772us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789024264.224182:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789024264.224296:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17170:1875927422403072:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789024264.224314:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1789024264.726505:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789024265.497730:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789024265.741074:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789024266.353215:0:19822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg218-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789024266.776917:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024267.661498:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422403200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789024267.661578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024267.661652:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403200 00000100:00100000:2.0:1789024267.661660:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403200 00000100:00100000:2.0:1789024267.661713:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789024267.661723:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422403200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789024267.661751:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789024267.661798:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422403200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024267.661820:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789024267.661843:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024267.661856:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422403328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789024267.661885:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024267.661943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422403200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024267.662356:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403328 00000100:00100000:3.0:1789024267.662362:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403328 00000100:00100000:3.0:1789024267.662422:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789024267.662427:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024267.662432:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422403328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024267.662446:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024267.662496:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422403328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024267.662503:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789024267.665525:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fa7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422403328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789024267.792054:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789024267.889213:0:19874:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789024267.898810:0:19874:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789024268.686018:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024268.686042:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024268.686130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024268.686287:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403456 00000100:00100000:0.0:1789024268.686296:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403456 00000100:00100000:0.0:1789024268.686350:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024268.686360:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422403456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024268.686392:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789024268.686441:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422403456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024268.686449:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024268.686504:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789024268.689722:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422403584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024268.689801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024268.690267:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403584 00000100:00100000:0.0:1789024268.690278:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403584 00000100:00100000:0.0:1789024268.690346:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024268.690356:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422403584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024268.690390:0:18205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789024268.690447:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422403584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024268.690454:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789024268.690695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422403584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789024268.813685:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789024268.842521:0:19924:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789024268.842831:0:19924:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789024269.102170:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.102205:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400640 00000100:00100000:3.0:1789024269.102216:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400640 00000100:00100000:3.0:1789024269.104058:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 114 00000100:00100000:3.0:1789024269.104077:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1875927402400640:12345-192.168.202.18@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789024269.104123:0:17138:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e4577274-ebf6-4f7f-a31d-56fffdb0df46@192.168.202.18@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:3.0:1789024269.104181:0:17138:0:(genops.c:1384:class_connect()) connect: client e4577274-ebf6-4f7f-a31d-56fffdb0df46, cookie 0xa736ef4b98cb4c38 00000100:00080000:3.0:1789024269.106330:0:17138:0:(import.c:65:import_set_state_nolock()) ffff90cb01af8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024269.106451:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+5:2399:x1875927402400640:12345-192.168.202.18@tcp:250:mount.lustre.0 Request processed in 2372us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.106473:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 114 00000100:00100000:3.0:1789024269.118813:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.119559:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400768 00000100:00100000:2.0:1789024269.119570:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400768 00000100:00100000:2.0:1789024269.119625:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00100000:2.0:1789024269.119636:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+5:14887:x1875927402400768:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789024269.119653:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024269.119671:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb4c3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af84b expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.119699:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb4c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af84b expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.119710:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa5000/0xa736ef4b98cb4c3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af84b expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.119718:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5000, rc 0) 00000100:00100000:2.0:1789024269.119841:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+6:14887:x1875927402400768:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 142us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.119863:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 115 00000100:00100000:0.0:1789024269.125260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.125356:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402400896 00000100:00100000:3.0:1789024269.125367:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402400896 00000100:00100000:3.0:1789024269.125427:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00100000:3.0:1789024269.125437:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+6:14887:x1875927402400896:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789024269.125581:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+6:14887:x1875927402400896:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 144us (341us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789024269.125598:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 116 00000100:00100000:3.0:1789024269.132299:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.132380:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401024 00000100:00100000:1.0:1789024269.132393:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401024 00000100:00100000:1.0:1789024269.132456:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 117 00000100:00100000:1.0:1789024269.132477:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+6:14887:x1875927402401024:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789024269.132502:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024269.132523:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb4c46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af852 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024269.132557:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb4c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af852 expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024269.132570:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00031a00/0xa736ef4b98cb4c46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af852 expref: 7 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024269.132580:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031a00, rc 0) 00000100:00100000:1.0:1789024269.132641:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+7:14887:x1875927402401024:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 166us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.132648:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 117 00000100:00100000:0.0:1789024269.134796:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.138343:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401152 00000100:00100000:2.0:1789024269.138360:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401152 00000100:00100000:0.0:1789024269.138661:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 118 00000100:00100000:0.0:1789024269.138673:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+7:14887:x1875927402401152:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789024269.139451:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14887:x1875927402401152:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 775us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024269.139460:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 118 00000100:00100000:3.0:1789024269.141765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.141831:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401280 00000100:00100000:1.0:1789024269.141841:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401280 00000100:00100000:1.0:1789024269.141975:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 119 00000100:00100000:1.0:1789024269.141985:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14887:x1875927402401280:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789024269.142459:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14887:x1875927402401280:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 474us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.142468:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 119 00000100:00100000:0.0:1789024269.148962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.149466:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401408 00000100:00100000:3.0:1789024269.149477:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401408 00000100:00100000:3.0:1789024269.149587:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 120 00000100:00100000:3.0:1789024269.149607:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401408:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789024269.149775:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401408:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 170us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.149783:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 120 00000100:00100000:0.0:1789024269.193066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.198025:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401536 00000100:00100000:1.0:1789024269.198043:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401536 00000100:00100000:1.0:1789024269.198143:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 121 00000100:00100000:2.0:1789024269.198703:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422403712:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.198774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.198810:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422404224:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.198895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.198915:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422404736:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.198938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.198953:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422405248:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.198975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.198996:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789024269.199002:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422403840:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.199027:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.199044:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422404352:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.199063:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.199080:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422404864:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.199097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.199135:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404224 00000100:00100000:2.0:1789024269.199140:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404224 00000100:00100000:1.0:1789024269.204709:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401536:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024269.204910:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401536:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 223us (11853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205030:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404736 00000100:00100000:2.0:1789024269.205039:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404736 00000100:00100000:2.0:1789024269.205054:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405248 00000100:00100000:2.0:1789024269.205056:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405248 00000100:00100000:2.0:1789024269.205078:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404864 00000100:00100000:2.0:1789024269.205081:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404864 00000100:00100000:2.0:1789024269.205107:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789024269.205114:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422404224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205211:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422404224:12345-0@lo:400:kworker.0 Request processed in 97us (6315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205218:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789024269.205235:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789024269.205253:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422404736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205282:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422404736:12345-0@lo:400:kworker.0 Request processed in 31us (6344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205288:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789024269.205301:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024269.205307:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422405248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205334:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422405248:12345-0@lo:400:kworker.0 Request processed in 28us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205340:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789024269.205350:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789024269.205356:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205379:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422404864:12345-0@lo:400:kworker.0 Request processed in 24us (6281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205385:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789024269.205419:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403840 00000100:00100000:2.0:1789024269.205423:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403840 00000100:00100000:2.0:1789024269.205446:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404352 00000100:00100000:2.0:1789024269.205449:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404352 00000100:00100000:2.0:1789024269.205461:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789024269.205467:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205523:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422403840:12345-0@lo:400:kworker.0 Request processed in 56us (6494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205530:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789024269.205541:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789024269.205547:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205574:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422404352:12345-0@lo:400:kworker.0 Request processed in 27us (6509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.205580:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789024269.205594:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024269.205598:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024269.205635:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422403840:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205648:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422404352:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.205661:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ec700 x1875927422404864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.205671:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422404864:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.205681:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc199bdf80 x1875927422404224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.205689:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422404224:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.205699:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ece00 x1875927422404736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.205706:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422404736:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.205716:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9eed80 x1875927422405248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.205735:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422405248:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205797:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422404096:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205835:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.205859:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422404608:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205877:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.205902:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422405120:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205927:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.205948:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789024269.205954:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422403968:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.205973:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.205989:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422404480:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206007:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.206025:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422404992:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024269.206074:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404096 00000100:00100000:2.0:1789024269.206078:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404096 00000100:00100000:2.0:1789024269.206105:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404608 00000100:00100000:2.0:1789024269.206108:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404608 00000100:00100000:2.0:1789024269.206117:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403968 00000100:00100000:2.0:1789024269.206119:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403968 00000100:00100000:2.0:1789024269.206129:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404480 00000100:00100000:2.0:1789024269.206131:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404480 00000100:00100000:2.0:1789024269.206143:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789024269.206177:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206213:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422404096:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206226:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789024269.206252:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789024269.206259:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422404608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206290:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422404608:12345-0@lo:400:kworker.0 Request processed in 32us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206295:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789024269.206306:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789024269.206311:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206337:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422403968:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206343:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789024269.206353:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789024269.206359:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422404480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206385:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422404480:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206390:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789024269.206407:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405120 00000100:00100000:2.0:1789024269.206410:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405120 00000100:00100000:2.0:1789024269.206432:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422404992 00000100:00100000:2.0:1789024269.206434:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422404992 00000100:00100000:2.0:1789024269.206447:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789024269.206452:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206479:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422405120:12345-0@lo:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206485:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789024269.206504:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789024269.206509:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206535:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422404992:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.206541:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789024269.206556:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024269.206559:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024269.206561:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789024269.206563:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789024269.206581:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422403968:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422404480:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.206600:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ef100 x1875927422404992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.206609:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422404992:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422404096:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206625:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422404608:0@lo:400:kworker.0 00010000:00080000:2.0:1789024269.206633:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3f9ed180 x1875927422405120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789024269.206641:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422405120:0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.206681:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422403712 00000100:00100000:2.0:1789024269.206685:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422403712 00000100:00100000:0.0:1789024269.206842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422405376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024269.206876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024269.206982:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024269.206991:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422405504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789024269.207014:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024269.217436:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405376 00000100:00100000:3.0:1789024269.217456:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405376 00000100:00100000:3.0:1789024269.217514:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405504 00000100:00100000:3.0:1789024269.217517:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405504 00000100:00100000:3.0:1789024269.217534:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789024269.217545:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422405376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789024269.217583:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789024269.217673:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875927422405376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (10796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.217680:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789024269.217697:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789024269.217704:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422405504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789024269.217714:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789024269.217743:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422405504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (10728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.217750:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024269.217929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422405376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024269.217984:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422405504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024269.218104:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 121 00000100:00100000:0.0:1789024269.224694:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.225717:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401664 00000100:00100000:2.0:1789024269.225729:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401664 00000100:00100000:2.0:1789024269.225771:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789024269.225781:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024269.225886:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422403712:12345-0@lo:400:kworker.0 Request processed in 106us (27111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.225895:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789024269.225924:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 123 00000100:00100000:2.0:1789024269.225931:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401664:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789024269.226055:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14906:x1875927402401664:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 123us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.226062:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 123 00000100:00100000:0.0:1789024269.226849:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422403712:0@lo:400:kworker.0 00000100:00100000:1.0:1789024269.246372:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.246466:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401792 00000100:00100000:2.0:1789024269.246477:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401792 00000100:00100000:2.0:1789024269.246545:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00100000:2.0:1789024269.246555:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+8:14887:x1875927402401792:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789024269.246572:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024269.246590:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb4c4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af883 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.246618:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb4c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af883 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.246630:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4e00/0xa736ef4b98cb4c4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af883 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024269.246638:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4e00, rc 0) 00000100:00100000:2.0:1789024269.246699:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+9:14887:x1875927402401792:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.246706:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 124 00000100:00100000:0.0:1789024269.265801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.265904:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402401920 00000100:00100000:1.0:1789024269.265916:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402401920 00000100:00100000:1.0:1789024269.265984:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:1.0:1789024269.265995:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+9:14887:x1875927402401920:12345-192.168.202.18@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789024269.266021:0:17136:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789024269.266047:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789024269.266051:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789024269.266054:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789024269.266057:0:17136:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789024269.266059:0:17136:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789024269.278754:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+9:14887:x1875927402401920:12345-192.168.202.18@tcp:256:mount.lustre.0 Request processed in 12750us (12952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.278769:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 125 00000100:00100000:0.0:1789024269.283751:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.283859:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402048 00000100:00100000:3.0:1789024269.283870:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402048 00000100:00100000:3.0:1789024269.283930:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:3.0:1789024269.283957:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3baaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+9:14887:x1875927402402048:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789024269.283975:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024269.283994:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af88a expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.284024:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.284036:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 10 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.284044:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161c00, rc 0) 00000100:00100000:3.0:1789024269.284105:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3baaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14887:x1875927402402048:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.284112:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 126 00000100:00100000:0.0:1789024269.294788:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.294885:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402176 00000100:00100000:2.0:1789024269.294898:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402176 00000100:00100000:2.0:1789024269.294958:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 127 00000100:00100000:2.0:1789024269.294969:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14887:x1875927402402176:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789024269.295130:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3d42b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14887:x1875927402402176:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 163us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.295139:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 127 00000100:00100000:0.0:1789024269.301392:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.301566:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402304 00000100:00100000:2.0:1789024269.301576:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402304 00000100:00100000:2.0:1789024269.301645:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 128 00000100:00100000:2.0:1789024269.301656:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14887:x1875927402402304:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789024269.301818:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14887:x1875927402402304:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 163us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.301825:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 128 00000100:00100000:0.0:1789024269.307266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.307973:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402432 00000100:00100000:3.0:1789024269.307984:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402432 00000100:00100000:3.0:1789024269.308056:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 129 00000100:00100000:3.0:1789024269.308067:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14913:x1875927402402432:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789024269.308535:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14913:x1875927402402432:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 467us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024269.308544:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 129 00000100:00100000:0.0:1789024269.316292:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.316355:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402560 00000100:00100000:1.0:1789024269.316366:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402560 00000100:00100000:1.0:1789024269.316432:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 130 00000100:00100000:1.0:1789024269.316442:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14913:x1875927402402560:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024269.316637:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:14913:x1875927402402560:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 196us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.316646:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 130 00000100:00100000:3.0:1789024269.349407:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.349513:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.356690:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402688 00000100:00100000:2.0:1789024269.356707:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402688 00000100:00100000:1.0:1789024269.361519:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402944 00000100:00100000:1.0:1789024269.361538:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402944 00000100:00100000:0.0:1789024269.365735:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:0.0:1789024269.365750:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875927402402688:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789024269.365788:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 371c06c4-35f7-46de-af51-de5f740e641b@192.168.202.18@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1789024269.365839:0:17143:0:(genops.c:1384:class_connect()) connect: client 371c06c4-35f7-46de-af51-de5f740e641b, cookie 0xa736ef4b98cb4c5b 00000004:00100000:0.0:1789024269.365873:0:17143:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789024269.366115:0:17143:0:(import.c:65:import_set_state_nolock()) ffff90cc18899800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024269.366220:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+6:2399:x1875927402402688:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 469us (16821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024269.366229:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:0.0:1789024269.366265:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:0.0:1789024269.366271:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1875927402402944:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789024269.366288:0:17143:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 371c06c4-35f7-46de-af51-de5f740e641b@192.168.202.18@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1789024269.366343:0:17143:0:(genops.c:1384:class_connect()) connect: client 371c06c4-35f7-46de-af51-de5f740e641b, cookie 0xa736ef4b98cb4c62 00000004:00100000:0.0:1789024269.366355:0:17143:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789024269.366487:0:17143:0:(import.c:65:import_set_state_nolock()) ffff90cc07069800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789024269.366520:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+6:2399:x1875927402402944:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 247us (17007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024269.366527:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:2.0:1789024269.382270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.382311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024269.382342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.382437:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402402816 00000100:00100000:1.0:1789024269.382451:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402402816 00000100:00100000:1.0:1789024269.382537:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403072 00000100:00100000:1.0:1789024269.382540:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403072 00000100:00100000:1.0:1789024269.382555:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403200 00000100:00100000:1.0:1789024269.382557:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403200 00000100:00100000:1.0:1789024269.382572:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:1.0:1789024269.382582:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+7:0:x1875927402402816:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789024269.382636:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024269.382716:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+7:0:x1875927402402816:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 135us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.382723:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:1.0:1789024269.382741:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:1.0:1789024269.382748:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:0:x1875927402403072:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789024269.382765:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024269.382799:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:0:x1875927402403072:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 52us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.382805:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:1.0:1789024269.382817:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:1.0:1789024269.382823:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403200:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789024269.382834:0:17144:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024269.382854:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403200:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.382860:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00080000:2.0:1789024269.383229:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789024269.383248:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024269.388939:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024269.389246:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403328 00000100:00100000:1.0:1789024269.389258:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403328 00000100:00100000:1.0:1789024269.389308:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:1.0:1789024269.389318:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403328:12345-192.168.202.18@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789024269.389421:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403328:12345-192.168.202.18@tcp:40:mount.lustre.0 Request processed in 104us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024269.389428:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:3.0:1789024269.392032:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.392072:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.392143:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024269.392335:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403712 00000100:00100000:0.0:1789024269.392345:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403712 00000100:00100000:0.0:1789024269.392402:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:0.0:1789024269.392412:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403712:12345-192.168.202.18@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789024269.392494:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403712:12345-192.168.202.18@tcp:900:mount.lustre.0 Request processed in 83us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024269.392500:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024269.392576:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403456 00000100:00100000:2.0:1789024269.392581:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403456 00000100:00100000:2.0:1789024269.392618:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403584 00000100:00100000:2.0:1789024269.392622:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403584 00000100:00100000:2.0:1789024269.392638:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:2.0:1789024269.392644:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875927402403456:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789024269.392684:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 371c06c4-35f7-46de-af51-de5f740e641b@192.168.202.18@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1789024269.392714:0:18654:0:(genops.c:1384:class_connect()) connect: client 371c06c4-35f7-46de-af51-de5f740e641b, cookie 0xa736ef4b98cb4c69 00002000:00100000:2.0:1789024269.392724:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 371c06c4-35f7-46de-af51-de5f740e641b/ffff90cb026e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789024269.392742:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789024269.392926:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789024269.392954:0:18654:0:(import.c:65:import_set_state_nolock()) ffff90cb026eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789024269.392985:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fa7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:371c06c4-35f7-46de-af51-de5f740e641b+6:2399:x1875927402403456:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 340us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.393007:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:2.0:1789024269.393024:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:2.0:1789024269.393029:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875927402403584:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789024269.393045:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 371c06c4-35f7-46de-af51-de5f740e641b@192.168.202.18@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1789024269.393062:0:18654:0:(genops.c:1384:class_connect()) connect: client 371c06c4-35f7-46de-af51-de5f740e641b, cookie 0xa736ef4b98cb4c70 00002000:00100000:2.0:1789024269.393068:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 371c06c4-35f7-46de-af51-de5f740e641b/ffff90cb026ee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789024269.393074:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789024269.393233:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789024269.393260:0:18654:0:(import.c:65:import_set_state_nolock()) ffff90cb026ea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789024269.393286:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:371c06c4-35f7-46de-af51-de5f740e641b+6:2399:x1875927402403584:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 256us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024269.393293:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:2.0:1789024269.401380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.401593:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403840 00000100:00100000:3.0:1789024269.401605:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403840 00000100:00100000:3.0:1789024269.401667:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:3.0:1789024269.401678:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403840:12345-192.168.202.18@tcp:33:mount.lustre.0 00000001:00100000:2.0:1789024269.404896:0:19467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 371c06c4-35f7-46de-af51-de5f740e641b 00000001:00080000:2.0:1789024269.404911:0:19467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00080000:0.0:1789024269.411190:0:17146:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9408us 00000004:00200000:3.0:1789024269.436070:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789024269.436377:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+6:14887:x1875927402403840:12345-192.168.202.18@tcp:33:mount.lustre.0 Request processed in 34694us (35000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.436389:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00000040:00080000:1.0:1789024269.452846:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789024269.649981:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024269.650658:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402403968 00000100:00100000:3.0:1789024269.650670:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402403968 00000100:00100000:3.0:1789024269.650733:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:3.0:1789024269.650744:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+6:14936:x1875927402403968:12345-192.168.202.18@tcp:101:mkdir.0 00010000:00010000:3.0:1789024269.650765:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024269.650792:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161600/0xa736ef4b98cb4c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af8bb expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.650871:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.650886:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.650901:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024269.650950:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024269.650955:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024269.651298:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.651328:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161600/0xa736ef4b98cb4c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8bb expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.651364:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8bb expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024269.651373:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:3.0:1789024269.651376:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024269.651379:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161e00, rc 0) 00000100:00100000:3.0:1789024269.651445:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb040b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+7:14936:x1875927402403968:12345-192.168.202.18@tcp:101:mkdir.0 Request processed in 703us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024269.651452:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00010000:00010000:0.0:1789024269.837105:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024270.860666:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789024271.884354:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024271.927258:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024271.927435:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404096 00000100:00100000:1.0:1789024271.927446:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404096 00000100:00100000:1.0:1789024271.927536:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:1.0:1789024271.927548:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+7:14988:x1875927402404096:12345-192.168.202.18@tcp:41:lfs.0 00000100:00080000:3.0:1789024271.927554:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789024271.927594:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024271.927678:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+7:14988:x1875927402404096:12345-192.168.202.18@tcp:41:lfs.0 Request processed in 133us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024271.927684:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:2.0:1789024271.935407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024271.935561:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404224 00000100:00100000:3.0:1789024271.935632:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404224 00000100:00100000:3.0:1789024271.935705:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:3.0:1789024271.935716:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+6:14988:x1875927402404224:12345-192.168.202.18@tcp:41:lfs.0 00000004:00000024:3.0:1789024271.935756:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789024271.935853:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+6:14988:x1875927402404224:12345-192.168.202.18@tcp:41:lfs.0 Request processed in 140us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024271.935862:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00080000:2.0:1789024271.935979:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789024271.940331:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024271.940481:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404352 00000100:00100000:3.0:1789024271.940500:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404352 00000100:00100000:3.0:1789024271.940581:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:3.0:1789024271.940592:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:371c06c4-35f7-46de-af51-de5f740e641b+6:14988:x1875927402404352:12345-192.168.202.18@tcp:13:lfs.0 00002000:00000024:3.0:1789024271.940624:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024271.940731:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:371c06c4-35f7-46de-af51-de5f740e641b+6:14988:x1875927402404352:12345-192.168.202.18@tcp:13:lfs.0 Request processed in 141us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024271.940745:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00080000:2.0:1789024271.941221:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789024271.949560:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024271.950030:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404480 00000100:00100000:3.0:1789024271.950041:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404480 00000100:00100000:3.0:1789024271.950118:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00100000:3.0:1789024271.950129:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:371c06c4-35f7-46de-af51-de5f740e641b+5:14988:x1875927402404480:12345-192.168.202.18@tcp:13:lfs.0 00002000:00000024:3.0:1789024271.950195:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789024271.950333:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:371c06c4-35f7-46de-af51-de5f740e641b+5:14988:x1875927402404480:12345-192.168.202.18@tcp:13:lfs.0 Request processed in 207us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024271.950341:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 12 00000100:00080000:2.0:1789024271.953436:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024272.195915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.196516:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404608 00000100:00100000:2.0:1789024272.196532:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404608 00000100:00100000:2.0:1789024272.196601:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 131 00000100:00100000:2.0:1789024272.196611:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+10:15021:x1875927402404608:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789024272.196630:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024272.196649:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb4c85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af8c2 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024272.196680:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb4c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8c2 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024272.196692:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc22fa4a00/0xa736ef4b98cb4c85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8c2 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024272.196702:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4a00, rc 0) 00000100:00100000:2.0:1789024272.196769:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402404608:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 160us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.196776:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 131 00000100:00100000:0.0:1789024272.213724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.213826:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404736 00000100:00100000:2.0:1789024272.213839:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404736 00000100:00100000:2.0:1789024272.213902:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 132 00000100:00100000:2.0:1789024272.213913:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402404736:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789024272.214076:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402404736:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 164us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.214098:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 132 00000100:00100000:0.0:1789024272.228340:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024272.228592:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404864 00000100:00100000:1.0:1789024272.228603:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404864 00000100:00100000:1.0:1789024272.228659:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 133 00000100:00100000:1.0:1789024272.228668:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402404864:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789024272.228806:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc089efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402404864:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 138us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.228814:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 133 00000100:00100000:0.0:1789024272.233529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.233743:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402404992 00000100:00100000:3.0:1789024272.233753:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402404992 00000100:00100000:3.0:1789024272.233811:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 134 00000100:00100000:3.0:1789024272.233820:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402404992:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789024272.233971:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402404992:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 151us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.233979:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 134 00000100:00100000:0.0:1789024272.258263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.259617:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405120 00000100:00100000:2.0:1789024272.259630:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405120 00000100:00100000:2.0:1789024272.259695:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 135 00000100:00100000:2.0:1789024272.259705:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402405120:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789024272.259870:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402405120:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 166us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.259878:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 135 00000100:00100000:0.0:1789024272.261797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024272.261911:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405248 00000100:00100000:1.0:1789024272.261923:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405248 00000100:00100000:1.0:1789024272.261975:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 136 00000100:00100000:1.0:1789024272.261985:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402405248:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024272.262129:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15027:x1875927402405248:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.262137:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 136 00000100:00100000:0.0:1789024272.266324:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.266421:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405376 00000100:00100000:3.0:1789024272.266433:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405376 00000100:00100000:3.0:1789024272.266503:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 137 00000100:00100000:3.0:1789024272.266514:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:15021:x1875927402405376:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789024272.266533:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024272.266552:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161600/0xa736ef4b98cb4c8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af8f3 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.266596:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161600/0xa736ef4b98cb4c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8f3 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.266622:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161600/0xa736ef4b98cb4c8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8f3 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.266631:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161600, rc 0) 00000100:00100000:3.0:1789024272.266692:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:15021:x1875927402405376:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 180us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.266699:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 137 00000100:00100000:0.0:1789024272.272090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.272183:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405504 00000100:00100000:2.0:1789024272.272193:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405504 00000100:00100000:2.0:1789024272.272259:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 138 00000100:00100000:2.0:1789024272.272269:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:15021:x1875927402405504:12345-192.168.202.18@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789024272.272296:0:17137:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789024272.272322:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789024272.272325:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789024272.272328:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789024272.272331:0:17137:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789024272.272334:0:17137:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789024272.275982:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:15021:x1875927402405504:12345-192.168.202.18@tcp:256:mount.lustre.0 Request processed in 3695us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.276000:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 138 00000100:00100000:0.0:1789024272.279245:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024272.279372:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405632 00000100:00100000:1.0:1789024272.279382:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405632 00000100:00100000:1.0:1789024272.279431:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:1.0:1789024272.279440:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:15021:x1875927402405632:12345-192.168.202.18@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789024272.279456:0:17136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024272.279477:0:17136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af8fa expref: -99 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024272.279506:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024272.279517:0:17136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024272.279526:0:17136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030600, rc 0) 00000100:00100000:1.0:1789024272.279586:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15021:x1875927402405632:12345-192.168.202.18@tcp:101:mount.lustre.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.279593:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 139 00000100:00100000:0.0:1789024272.281800:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.281873:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405760 00000100:00100000:2.0:1789024272.281882:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405760 00000100:00100000:2.0:1789024272.281928:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:2.0:1789024272.281936:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15021:x1875927402405760:12345-192.168.202.18@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789024272.282084:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15021:x1875927402405760:12345-192.168.202.18@tcp:501:mount.lustre.0 Request processed in 148us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.282092:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 140 00000100:00100000:0.0:1789024272.283984:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.284051:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402405888 00000100:00100000:3.0:1789024272.284059:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402405888 00000100:00100000:3.0:1789024272.284102:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 141 00000100:00100000:3.0:1789024272.284110:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15021:x1875927402405888:12345-192.168.202.18@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789024272.284274:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15021:x1875927402405888:12345-192.168.202.18@tcp:503:mount.lustre.0 Request processed in 163us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.284282:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 141 00000100:00100000:0.0:1789024272.287829:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024272.287964:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406016 00000100:00100000:1.0:1789024272.287974:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406016 00000100:00100000:1.0:1789024272.288029:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:1.0:1789024272.288038:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15033:x1875927402406016:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789024272.288221:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15033:x1875927402406016:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 171us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.288235:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 142 00000100:00100000:0.0:1789024272.295024:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.295115:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406144 00000100:00100000:2.0:1789024272.295124:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406144 00000100:00100000:2.0:1789024272.295205:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 143 00000100:00100000:2.0:1789024272.295228:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15033:x1875927402406144:12345-192.168.202.18@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789024272.295399:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:15033:x1875927402406144:12345-192.168.202.18@tcp:502:llog_process_th.0 Request processed in 172us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.295406:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 143 00000100:00100000:0.0:1789024272.308526:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024272.308633:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.308717:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406272 00000100:00100000:3.0:1789024272.308727:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406272 00000100:00100000:3.0:1789024272.308770:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406528 00000100:00100000:3.0:1789024272.308773:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406528 00000100:00100000:3.0:1789024272.308785:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:3.0:1789024272.308793:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875927402406272:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789024272.308822:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7a8dfb3b-d145-43b9-83c6-a1d231848389@192.168.202.18@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1789024272.308885:0:17145:0:(genops.c:1384:class_connect()) connect: client 7a8dfb3b-d145-43b9-83c6-a1d231848389, cookie 0xa736ef4b98cb4c9a 00000004:00100000:3.0:1789024272.308910:0:17145:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789024272.309014:0:17145:0:(import.c:65:import_set_state_nolock()) ffff90cc35248000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024272.309090:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2399:x1875927402406272:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 296us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.309102:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:3.0:1789024272.309119:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:3.0:1789024272.309123:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1875927402406528:12345-192.168.202.18@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789024272.309138:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7a8dfb3b-d145-43b9-83c6-a1d231848389@192.168.202.18@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1789024272.309188:0:17145:0:(genops.c:1384:class_connect()) connect: client 7a8dfb3b-d145-43b9-83c6-a1d231848389, cookie 0xa736ef4b98cb4ca1 00000004:00100000:3.0:1789024272.309199:0:17145:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789024272.309255:0:17145:0:(import.c:65:import_set_state_nolock()) ffff90cc3524c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024272.309277:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2399:x1875927402406528:12345-192.168.202.18@tcp:38:mount.lustre.0 Request processed in 152us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.309283:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:0.0:1789024272.316293:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.316392:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406784 00000100:00100000:3.0:1789024272.316403:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406784 00000100:00100000:3.0:1789024272.316485:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:3.0:1789024272.316495:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402406784:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789024272.316536:0:17145:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789024272.316627:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402406784:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.316634:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00080000:2.0:1789024272.317105:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789024272.321879:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.321924:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024272.322014:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406656 00000100:00100000:1.0:1789024272.322026:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406656 00000100:00100000:1.0:1789024272.322093:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406400 00000100:00100000:1.0:1789024272.322097:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406400 00000100:00100000:1.0:1789024272.322113:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:1.0:1789024272.322122:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:0:x1875927402406656:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789024272.322197:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789024272.322276:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:0:x1875927402406656:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 153us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.322283:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:1.0:1789024272.322300:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:1.0:1789024272.322307:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:0:x1875927402406400:12345-192.168.202.18@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789024272.322318:0:17143:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789024272.322341:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:0:x1875927402406400:12345-192.168.202.18@tcp:41:mount.lustre.0 Request processed in 35us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.322347:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00080000:2.0:1789024272.322899:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024272.325451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024272.325552:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402406912 00000100:00100000:0.0:1789024272.325571:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402406912 00000100:00100000:0.0:1789024272.325622:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:0.0:1789024272.325631:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402406912:12345-192.168.202.18@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789024272.325710:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402406912:12345-192.168.202.18@tcp:40:mount.lustre.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024272.325716:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:0.0:1789024272.335055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024272.335104:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.335518:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407296 00000100:00100000:2.0:1789024272.335528:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407296 00000100:00100000:2.0:1789024272.335591:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:2.0:1789024272.335602:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402407296:12345-192.168.202.18@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789024272.335674:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402407296:12345-192.168.202.18@tcp:900:mount.lustre.0 Request processed in 75us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.335680:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:0.0:1789024272.336191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024272.341555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024272.341988:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407424 00000100:00100000:2.0:1789024272.341998:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407424 00000100:00100000:2.0:1789024272.342049:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:2.0:1789024272.342059:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402407424:12345-192.168.202.18@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789024272.342169:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789024272.342256:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15021:x1875927402407424:12345-192.168.202.18@tcp:33:mount.lustre.0 Request processed in 197us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024272.342264:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:3.0:1789024272.354674:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407040 00000100:00100000:3.0:1789024272.354689:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407040 00000100:00100000:3.0:1789024272.354738:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407168 00000100:00100000:3.0:1789024272.354741:0:18654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407168 00000100:00100000:3.0:1789024272.354770:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024272.354779:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875927402407040:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789024272.354813:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7a8dfb3b-d145-43b9-83c6-a1d231848389@192.168.202.18@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1789024272.354864:0:18654:0:(genops.c:1384:class_connect()) connect: client 7a8dfb3b-d145-43b9-83c6-a1d231848389, cookie 0xa736ef4b98cb4ca8 00002000:00100000:3.0:1789024272.354876:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a8dfb3b-d145-43b9-83c6-a1d231848389/ffff90cc3524f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789024272.354886:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789024272.354963:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789024272.354994:0:18654:0:(import.c:65:import_set_state_nolock()) ffff90cc3524d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024272.355063:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2399:x1875927402407040:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 284us (19958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.355072:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:3.0:1789024272.355088:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:3.0:1789024272.355092:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1875927402407168:12345-192.168.202.18@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789024272.355106:0:18654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7a8dfb3b-d145-43b9-83c6-a1d231848389@192.168.202.18@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1789024272.355121:0:18654:0:(genops.c:1384:class_connect()) connect: client 7a8dfb3b-d145-43b9-83c6-a1d231848389, cookie 0xa736ef4b98cb4caf 00002000:00100000:3.0:1789024272.355126:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a8dfb3b-d145-43b9-83c6-a1d231848389/ffff90cc35248800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789024272.355131:0:18654:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789024272.355202:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789024272.355430:0:18654:0:(import.c:65:import_set_state_nolock()) ffff90cc3524e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789024272.355457:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2399:x1875927402407168:12345-192.168.202.18@tcp:8:mount.lustre.0 Request processed in 362us (19266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.355464:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:0.0:1789024272.503817:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024272.504019:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407552 00000100:00100000:3.0:1789024272.504030:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407552 00000100:00100000:3.0:1789024272.504093:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:3.0:1789024272.504102:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15056:x1875927402407552:12345-192.168.202.18@tcp:101:mkdir.0 00010000:00010000:3.0:1789024272.504122:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024272.504189:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160600/0xa736ef4b98cb4cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af92b expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504274:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504287:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504301:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024272.504341:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024272.504344:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024272.504361:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504385:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160600/0xa736ef4b98cb4cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504402:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024272.504411:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:3.0:1789024272.504414:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024272.504418:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161200, rc 0) 00000100:00100000:3.0:1789024272.504484:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+7:15056:x1875927402407552:12345-192.168.202.18@tcp:101:mkdir.0 Request processed in 383us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.504491:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:0.0:1789024272.781846:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789024272.781878:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422405760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024272.781949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024272.782097:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405760 00000100:00100000:3.0:1789024272.782114:0:18655:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405760 00000100:00100000:3.0:1789024272.782194:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789024272.782216:0:18655:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422405760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024272.782239:0:18655:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024272.782280:0:18655:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422405760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024272.782287:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789024272.782352:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024272.782384:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422405760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024272.783102:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422405632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024272.783140:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024272.783219:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405632 00000100:00100000:1.0:1789024272.783224:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405632 00000100:00100000:1.0:1789024272.783249:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789024272.783255:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422405632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024272.783268:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789024272.783307:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422405632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024272.783314:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789024272.783346:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422405632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789024272.783464:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789024272.908600:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024273.804542:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024273.804565:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422405888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789024273.804634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024273.805060:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422405888 00000100:00100000:0.0:1789024273.805076:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422405888 00000100:00100000:0.0:1789024273.805207:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789024273.805221:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422405888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789024273.805280:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789024273.805372:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422405888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024273.805395:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789024273.805611:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422405888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024273.813185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422406016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789024273.813297:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024273.817090:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406016 00000100:00100000:0.0:1789024273.817110:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406016 00000100:00100000:0.0:1789024273.817401:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789024273.817418:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422406016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024273.817477:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789024273.817595:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875927422406016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024273.817602:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789024273.817665:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875927422406016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024273.935308:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024274.319906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422406144:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320007:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320064:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422406528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024274.320095:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024274.320112:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406144 00000100:00100000:0.0:1789024274.320114:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422407168:0@lo:400:kworker.0 00000100:00100000:3.0:1789024274.320122:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406144 00000100:00100000:0.0:1789024274.320137:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422407680:0@lo:400:kworker.0 00000100:00100000:3.0:1789024274.320217:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789024274.320219:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024274.320228:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3644:x1875927422406144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320246:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789024274.320252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422406656:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320274:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320289:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422407040:0@lo:400:kworker.0 00000100:00100000:3.0:1789024274.320290:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3644:x1875927422406144:12345-0@lo:400:kworker.0 Request processed in 64us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024274.320298:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789024274.320321:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422407552:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320361:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422406144:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422406272:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422406784:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320542:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422407296:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320574:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422407808:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320596:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320608:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789024274.320614:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422406400:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320651:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422406912:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320685:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422407424:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.320703:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024274.320736:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406528 00000100:00100000:0.0:1789024274.320742:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406528 00000100:00100000:0.0:1789024274.320787:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789024274.320796:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422406528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789024274.320826:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789024274.320874:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422406528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.320882:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789024274.320904:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407168 00000100:00100000:0.0:1789024274.320908:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407168 00000100:00100000:0.0:1789024274.320927:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406656 00000100:00100000:0.0:1789024274.320929:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406656 00000100:00100000:0.0:1789024274.320937:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407040 00000100:00100000:0.0:1789024274.320938:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407040 00000100:00100000:0.0:1789024274.320951:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406400 00000100:00100000:0.0:1789024274.320952:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406400 00000100:00100000:0.0:1789024274.320965:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024274.320971:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422407168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321001:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422407168:12345-0@lo:400:kworker.0 Request processed in 30us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321006:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024274.321017:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024274.321023:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422406656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321044:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422406656:12345-0@lo:400:kworker.0 Request processed in 23us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321050:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024274.321059:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024274.321065:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422407040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321106:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422407040:12345-0@lo:400:kworker.0 Request processed in 41us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321112:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024274.321122:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789024274.321128:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422406400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321202:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422406400:12345-0@lo:400:kworker.0 Request processed in 59us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321209:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789024274.321232:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407680 00000100:00100000:0.0:1789024274.321235:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407680 00000100:00100000:0.0:1789024274.321257:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407552 00000100:00100000:0.0:1789024274.321260:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407552 00000100:00100000:0.0:1789024274.321273:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406784 00000100:00100000:0.0:1789024274.321276:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406784 00000100:00100000:0.0:1789024274.321284:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407296 00000100:00100000:0.0:1789024274.321287:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407296 00000100:00100000:0.0:1789024274.321295:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407808 00000100:00100000:0.0:1789024274.321297:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407808 00000100:00100000:0.0:1789024274.321309:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407424 00000100:00100000:0.0:1789024274.321311:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407424 00000100:00100000:0.0:1789024274.321338:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789024274.321344:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422407680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321377:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875927422407680:12345-0@lo:400:kworker.0 Request processed in 33us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321383:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789024274.321396:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789024274.321401:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422407552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321426:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875927422407552:12345-0@lo:400:kworker.0 Request processed in 25us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321432:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789024274.321443:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789024274.321448:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422406784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321472:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875927422406784:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321484:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789024274.321497:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789024274.321502:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422407296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321527:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422407296:12345-0@lo:400:kworker.0 Request processed in 25us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321533:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789024274.321542:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024274.321547:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321569:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422407808:12345-0@lo:400:kworker.0 Request processed in 22us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321574:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789024274.321583:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024274.321588:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422407424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321610:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875927422407424:12345-0@lo:400:kworker.0 Request processed in 23us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321616:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789024274.321644:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406272 00000100:00100000:0.0:1789024274.321648:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406272 00000100:00100000:0.0:1789024274.321671:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422406912 00000100:00100000:0.0:1789024274.321674:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422406912 00000100:00100000:0.0:1789024274.321685:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789024274.321691:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422406272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321723:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422406272:12345-0@lo:400:kworker.0 Request processed in 31us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321728:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789024274.321747:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789024274.321752:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422406912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321779:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422406912:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024274.321784:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1789024274.321808:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789024274.321813:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789024274.321816:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789024274.321818:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024274.321855:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422406400:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321865:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422406912:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321877:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875927422407424:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321887:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422406272:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321897:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875927422406784:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321907:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422407296:0@lo:400:kworker.0 00010000:00080000:0.0:1789024274.321921:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8ed80 x1875927422407808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024274.321932:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422407808:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.321977:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789024274.321991:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422406656:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.322003:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422407040:0@lo:400:kworker.0 00010000:00080000:0.0:1789024274.322013:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3bf8f800 x1875927422407552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789024274.322035:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875927422407552:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.322057:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422406528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024274.322068:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422407168:0@lo:400:kworker.0 00000100:00100000:0.0:1789024274.322079:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875927422407680:0@lo:400:kworker.0 00000100:00100000:3.0:1789024274.322579:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024274.322596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422407936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024274.322650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024274.322748:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422407936 00000100:00100000:2.0:1789024274.322756:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422407936 00000100:00100000:2.0:1789024274.322814:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789024274.322824:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422407936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024274.322843:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789024274.322891:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422407936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024274.322898:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789024274.322939:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422407936:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1789024274.836948:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7a8dfb3b-d145-43b9-83c6-a1d231848389 00000001:00100000:0.0:1789024274.836969:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 371c06c4-35f7-46de-af51-de5f740e641b 00000001:00100000:0.0:1789024274.838624:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a8dfb3b-d145-43b9-83c6-a1d231848389 00000001:00100000:0.0:1789024274.838640:0:18648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 371c06c4-35f7-46de-af51-de5f740e641b 00000001:00100000:2.0:1789024274.838714:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a8dfb3b-d145-43b9-83c6-a1d231848389 00000001:00100000:2.0:1789024274.838723:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 371c06c4-35f7-46de-af51-de5f740e641b 00010000:00010000:3.0:1789024274.956374:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789024275.729471:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789024275.989241:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789024276.107131:0:20022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789024277.005089:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024277.523074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523108:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523137:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523187:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523203:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523217:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523231:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523244:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523259:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024277.523307:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407680 00000100:00100000:3.0:1789024277.523316:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407680 00000100:00100000:3.0:1789024277.523359:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 145 00000100:00100000:3.0:1789024277.523367:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2401:x1875927402407680:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523425:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2401:x1875927402407680:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 59us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523432:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 145 00000100:00100000:3.0:1789024277.523459:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407936 00000100:00100000:3.0:1789024277.523462:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407936 00000100:00100000:3.0:1789024277.523488:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408448 00000100:00100000:3.0:1789024277.523490:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408448 00000100:00100000:3.0:1789024277.523500:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402407808 00000100:00100000:3.0:1789024277.523502:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402407808 00000100:00100000:3.0:1789024277.523511:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408320 00000100:00100000:3.0:1789024277.523513:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408320 00000100:00100000:3.0:1789024277.523526:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:3.0:1789024277.523531:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402407936:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523556:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402407936:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523562:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:3.0:1789024277.523572:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:3.0:1789024277.523577:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2401:x1875927402408448:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523592:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2401:x1875927402408448:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 16us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523597:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:3.0:1789024277.523606:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:3.0:1789024277.523611:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:2401:x1875927402407808:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523635:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:2401:x1875927402407808:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523641:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:3.0:1789024277.523650:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:3.0:1789024277.523655:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2401:x1875927402408320:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523670:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2401:x1875927402408320:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 16us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523675:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:3.0:1789024277.523689:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408192 00000100:00100000:3.0:1789024277.523692:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408192 00000100:00100000:3.0:1789024277.523707:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408704 00000100:00100000:3.0:1789024277.523709:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408704 00000100:00100000:3.0:1789024277.523717:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408064 00000100:00100000:3.0:1789024277.523719:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408064 00000100:00100000:3.0:1789024277.523728:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408576 00000100:00100000:3.0:1789024277.523729:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408576 00000100:00100000:3.0:1789024277.523740:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:3.0:1789024277.523745:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402408192:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523764:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402408192:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 19us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523769:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:3.0:1789024277.523778:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:3.0:1789024277.523783:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2401:x1875927402408704:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523797:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2401:x1875927402408704:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 15us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523811:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:3.0:1789024277.523820:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:3.0:1789024277.523825:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402408064:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523842:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+5:2401:x1875927402408064:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 17us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523847:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:3.0:1789024277.523854:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:3.0:1789024277.523859:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2401:x1875927402408576:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024277.523872:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2401:x1875927402408576:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 13us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.523877:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00080000:3.0:1789024277.524046:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789024277.524049:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789024277.524052:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024277.524054:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024277.900394:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024277.900421:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422408064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789024277.900578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024277.900631:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422408192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024277.900773:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408064 00000100:00100000:3.0:1789024277.900782:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408064 00000100:00100000:0.0:1789024277.900790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024277.900840:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408192 00000100:00100000:3.0:1789024277.900844:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408192 00000100:00100000:3.0:1789024277.900874:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789024277.900884:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422408064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024277.900913:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024277.900975:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422408064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.900981:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789024277.901005:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789024277.901011:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422408192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024277.901020:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024277.901044:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422408192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024277.901050:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789024277.901068:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789024277.901525:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422408192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789024277.901538:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422408064:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789024277.906263:0:19467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a8dfb3b-d145-43b9-83c6-a1d231848389 00010000:00010000:3.0:1789024278.028314:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024278.924547:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789024278.924590:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422408320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024278.924762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024278.925055:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408320 00000100:00100000:0.0:1789024278.925064:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408320 00000100:00100000:0.0:1789024278.925121:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789024278.925131:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422408320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024278.925193:0:18205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789024278.925257:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422408320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024278.925272:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789024278.925275:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422408320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789024278.928073:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789024278.928101:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422408448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024278.928250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024278.928305:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408448 00000100:00100000:2.0:1789024278.928313:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408448 00000100:00100000:2.0:1789024278.928357:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789024278.928365:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422408448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789024278.928396:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789024278.928479:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422408448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024278.928487:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789024278.928690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422408448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789024279.052427:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024279.436428:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024279.436470:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422408704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024279.436541:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422408832:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.436542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.436589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422408576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024279.436590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.436624:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.436663:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422408960:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.436695:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024279.436710:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422409344:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.436733:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408704 00000100:00100000:1.0:1789024279.436742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.436743:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408704 00000100:00100000:3.0:1789024279.436793:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408576 00000100:00100000:1.0:1789024279.436797:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789024279.436798:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408576 00000100:00100000:1.0:1789024279.436808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422409472:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.436823:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789024279.436833:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422408704:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789024279.436839:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789024279.436868:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789024279.436897:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422409856:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.436916:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422408704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.436926:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789024279.436930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.436951:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789024279.436960:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422408576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789024279.436976:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789024279.436984:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422409984:0@lo:400:kworker.0 00002000:00000024:3.0:1789024279.436988:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789024279.437021:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.437028:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422408576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.437036:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789024279.437062:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408832 00000100:00100000:3.0:1789024279.437067:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408832 00000100:00100000:1.0:1789024279.437097:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409856 00000100:00100000:3.0:1789024279.437098:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789024279.437104:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409856 00000100:00100000:3.0:1789024279.437109:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422408832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.437247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422409088:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.437326:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409984 00000100:00100000:1.0:1789024279.437330:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409984 00000100:00100000:1.0:1789024279.437351:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789024279.437358:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422409856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024279.437538:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422408960 00000100:00100000:2.0:1789024279.437543:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422408960 00000100:00100000:2.0:1789024279.437570:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409344 00000100:00100000:2.0:1789024279.437574:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409344 00000100:00100000:2.0:1789024279.437588:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789024279.437595:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.437715:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024279.437739:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422409600:0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.437761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024279.438216:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.438305:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875927422409856:12345-0@lo:400:kworker.0 Request processed in 946us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024279.438315:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789024279.438323:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422408832:12345-0@lo:400:kworker.0 Request processed in 1213us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.438334:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789024279.438340:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409600 00000100:00100000:1.0:1789024279.438345:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409600 00000100:00100000:1.0:1789024279.438369:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789024279.438378:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409472 00000100:00100000:1.0:1789024279.438378:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422409984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.438385:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409472 00000100:00100000:3.0:1789024279.438418:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409088 00000100:00100000:1.0:1789024279.438419:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422409984:12345-0@lo:400:kworker.0 Request processed in 42us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.438424:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409088 00000100:00100000:1.0:1789024279.438429:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789024279.438448:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789024279.438456:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789024279.438537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024279.438558:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789024279.438564:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422409216:0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.438586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.438590:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422409472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.438600:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422409728:0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.438616:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024279.438658:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422409472:12345-0@lo:400:kworker.0 Request processed in 73us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.438666:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789024279.438670:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422409600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.438680:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789024279.438688:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.438723:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875927422409600:12345-0@lo:400:kworker.0 Request processed in 268us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024279.438730:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789024279.438779:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422409088:12345-0@lo:400:kworker.0 Request processed in 92us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.438786:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789024279.438845:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422408704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024279.438877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422408576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789024279.438939:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422409088:0@lo:400:kworker.0 00000100:00100000:0.0:1789024279.438952:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875927422409600:0@lo:400:kworker.0 00000100:00100000:3.0:1789024279.439038:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789024279.439049:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439053:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422410112 00000100:00100000:1.0:1789024279.439058:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422410112 00000100:00100000:1.0:1789024279.439085:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409216 00000100:00100000:1.0:1789024279.439088:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409216 00000100:00100000:3.0:1789024279.439094:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422409344:12345-0@lo:400:kworker.0 Request processed in 48us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024279.439103:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789024279.439103:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422409728 00000100:00100000:1.0:1789024279.439108:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422409728 00000100:00100000:1.0:1789024279.439139:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789024279.439173:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422410112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789024279.439189:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789024279.439195:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789024279.439198:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024279.439201:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789024279.439216:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875927422410112:12345-0@lo:400:kworker.0 Request processed in 44us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024279.439222:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789024279.439234:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789024279.439246:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439273:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422409216:12345-0@lo:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024279.439278:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789024279.439289:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789024279.439295:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422409728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439321:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422409728:12345-0@lo:400:kworker.0 Request processed in 26us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024279.439326:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789024279.439357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422409216:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422409728:0@lo:400:kworker.0 00010000:00080000:1.0:1789024279.439385:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc107bb100 x1875927422410112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024279.439395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875927422410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422409984:0@lo:400:kworker.0 00010000:00080000:1.0:1789024279.439449:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc107bad80 x1875927422409856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024279.439653:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875927422409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439668:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422409472:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439676:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422409344:0@lo:400:kworker.0 00000100:00100000:1.0:1789024279.439684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422408832:0@lo:400:kworker.0 00000100:00100000:2.0:1789024279.439843:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875927422408960:12345-0@lo:400:kworker.0 Request processed in 2242us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024279.439852:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789024279.439896:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875927422408960:0@lo:400:kworker.0 00000040:00080000:0.0:1789024279.693000:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789024280.076512:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789024280.243812:0:20170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb9c35300 20000000:00000080:0.0:1789024280.243843:0:20170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90cb01ab8800 uarg=0000000000000000 20000000:01000000:0.0:1789024280.243983:0:20170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789024280.243993:0:20170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789024280.244000:0:20170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789024280.245328:0:20171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789024280.245420:0:20170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789024280.266799:0:20170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789024280.266869:0:20170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266908:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266916:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266923:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266931:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266941:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266949:0:20170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.266956:0:20170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267000:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267016:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 12 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267032:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410240:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024280.267299:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267316:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267325:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410368:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024280.267366:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267374:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 23 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267385:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410496:0@lo:104: 00000100:00100000:0.0:1789024280.267766:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789024280.267811:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267820:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 23 pid: 17138 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267827:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410624:0@lo:104: 00000100:00100000:0.0:1789024280.267848:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789024280.267869:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 23 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267876:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 23 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267884:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410752:0@lo:104: 00000100:00100000:0.0:1789024280.267903:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789024280.267929:0:20170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 23 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.267936:0:20170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 23 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.267944:0:20170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410880:0@lo:104: 00000100:00100000:0.0:1789024280.267966:0:20170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024280.267977:0:20170:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc1004f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789024280.268415:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422410496 00000100:00100000:1.0:1789024280.268423:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422410496 00000100:00100000:1.0:1789024280.268465:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422410624 00000100:00100000:1.0:1789024280.268468:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422410624 00000100:00100000:1.0:1789024280.268477:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422410752 00000100:00100000:1.0:1789024280.268479:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422410752 00000100:00100000:1.0:1789024280.268488:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422410880 00000100:00100000:1.0:1789024280.268490:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422410880 00000100:00100000:1.0:1789024280.268503:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789024280.268512:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:20170:x1875927422410496:12345-0@lo:104: 00010000:00010000:1.0:1789024280.268526:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268599:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789024280.268605:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+6:20170:x1875927422410496:12345-0@lo:104: Request processed in 94us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.268613:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789024280.268640:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789024280.268648:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:20170:x1875927422410624:12345-0@lo:104: 00010000:00010000:1.0:1789024280.268656:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268701:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789024280.268707:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+5:20170:x1875927422410624:12345-0@lo:104: Request processed in 61us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.268712:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789024280.268739:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789024280.268746:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:20170:x1875927422410752:12345-0@lo:104: 00010000:00010000:1.0:1789024280.268762:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268797:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789024280.268802:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+4:20170:x1875927422410752:12345-0@lo:104: Request processed in 57us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.268808:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789024280.268822:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789024280.268827:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:20170:x1875927422410880:12345-0@lo:104: 00010000:00010000:1.0:1789024280.268835:0:17127:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268858:0:17127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789024280.268862:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+3:20170:x1875927422410880:12345-0@lo:104: Request processed in 36us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.268866:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789024280.268887:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789024280.268894:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268902:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ae00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024280.268907:0:18299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.268918:0:18299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.268920:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1789024280.268935:0:18299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.268940:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024280.268994:0:18299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789024280.268995:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01323600 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:2.0:1789024280.269004:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269031:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269035:0:18299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269045:0:18299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789024280.269065:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269073:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0338ae00/0xa736ef4b98cb4afd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4b04 expref: -99 pid: 19466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024280.269104:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024280.269112:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789024280.269230:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410496:0@lo:104: 00000100:00100000:0.0:1789024280.269241:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fabb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410624:0@lo:104: 00000100:00100000:0.0:1789024280.269247:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410752:0@lo:104: 00000100:00100000:0.0:1789024280.269254:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3be9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410880:0@lo:104: 00010000:00010000:1.0:1789024280.269318:0:18299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789024280.269322:0:18299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269330:0:18299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc029c5e00 already unused, calling callback (ffffffffc146cc20) 10000000:00010000:1.0:1789024280.269334:0:18299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269343:0:18299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789024280.269349:0:18299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789024280.269355:0:18299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789024280.269467:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269478:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024280.269594:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269602:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc01323600/0xa736ef4b98cb499f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb49a6 expref: -99 pid: 18647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269622:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789024280.269626:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269676:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338ac00 already unused, calling callback (ffffffffc146cc20) 00010000:00010000:1.0:1789024280.269678:0:18299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.269681:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422411136:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789024280.269682:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269733:0:18299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789024280.269735:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789024280.269754:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269763:0:18299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024280.269816:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789024280.269817:0:18299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cc029c5e00/0xa736ef4b98cb4960 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4967 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269845:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024280.269848:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024280.269851:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024280.269859:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.269872:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024280.269874:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789024280.269874:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789024280.269896:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024280.269906:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.118@tcp lock: ffff90cb0338ac00/0xa736ef4b98cb4952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa736ef4b98cb4959 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024280.269917:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422411008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789024280.269932:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024280.269937:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789024280.269941:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024280.269967:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422411264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024280.269995:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024280.270039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024280.270054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789024280.270066:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411136 00000100:00100000:1.0:1789024280.270067:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422411392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024280.270083:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411136 00010000:00010000:0.0:1789024280.270123:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 24 pid: 17138 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.270199:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411008 00000100:00100000:0.0:1789024280.270203:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411008 00010000:00010000:0.0:1789024280.270217:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 25 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.270243:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024280.270254:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+25:3641:x1875927422411136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024280.270271:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024280.270286:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 25 pid: 17138 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270298:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 25 pid: 17138 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270316:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01323800/0xa736ef4b98cb49a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb499f expref: 25 pid: 17138 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270331:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024280.270379:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422411136:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024280.270386:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789024280.270405:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411264 00000100:00100000:0.0:1789024280.270408:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411264 00010000:00010000:0.0:1789024280.270420:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 24 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024280.270432:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024280.270437:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3644:x1875927422411008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024280.270445:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024280.270449:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270458:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270468:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030800/0xa736ef4b98cb4b04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb4afd expref: 24 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270477:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024280.270512:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:3644:x1875927422411008:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024280.270520:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789024280.270533:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024280.270539:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:3642:x1875927422411264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789024280.270548:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024280.270552:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 22 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270561:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 22 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270572:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc029c5800/0xa736ef4b98cb4967 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb4960 expref: 22 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.270582:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024280.270608:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422411136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789024280.270614:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3642:x1875927422411264:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024280.270623:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789024280.270661:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3642:1875927422411264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024280.272281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024280.272370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422411008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789024280.272451:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411392 00000100:00100000:1.0:1789024280.272460:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411392 00010000:00010000:1.0:1789024280.272501:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 21 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024280.272549:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789024280.272558:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:3644:x1875927422411392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789024280.272574:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024280.272579:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 21 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.272590:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 21 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.272624:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc01322400/0xa736ef4b98cb4959 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa736ef4b98cb4952 expref: 21 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.272640:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024280.272686:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:3644:x1875927422411392:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.272693:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789024280.272721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3644:1875927422411392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789024280.284726:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024280.284771:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024280.284884:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3f9f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410240:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024280.284895:0:20170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fab8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20170:1875927422410368:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024280.284939:0:20170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024280.285119:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408832 00000100:00100000:1.0:1789024280.285126:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408832 00010000:00010000:1.0:1789024280.285198:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 13 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024280.285240:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402408960 00000100:00100000:1.0:1789024280.285243:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402408960 00010000:00010000:1.0:1789024280.285255:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 14 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024280.285272:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:1.0:1789024280.285280:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+14:2402:x1875927402408832:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024280.285294:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024280.285300:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 14 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285310:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 14 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285326:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc00030600/0xa736ef4b98cb4c93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8fa expref: 14 pid: 17136 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285356:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024280.285405:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2402:x1875927402408832:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 125us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.285412:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 13 00000100:00100000:1.0:1789024280.285487:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 14 00000100:00100000:1.0:1789024280.285495:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:2402:x1875927402408960:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024280.285503:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024280.285507:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285516:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285527:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4c54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af88a expref: 12 pid: 17137 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285538:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285547:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285561:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285569:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285587:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285596:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285603:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252f600 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024280.285608:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285630:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285643:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024280.285653:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024280.285674:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:2402:x1875927402408960:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 180us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024280.285682:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 14 00010000:00010000:0.0:1789024280.288264:0:20170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.288305:0:20170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024280.288313:0:20170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90cb0252f600/0xa736ef4b98cb4cc4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024281.100463:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789024281.948306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024281.949601:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409088 00000100:00100000:3.0:1789024281.949617:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409088 00000100:00100000:3.0:1789024281.949681:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 147 00000100:00100000:3.0:1789024281.949692:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+11:14902:x1875927402409088:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024281.949708:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024281.949730:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb4ccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af932 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.949758:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb4ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af932 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.949769:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160400/0xa736ef4b98cb4ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af932 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.949778:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160400, rc 0) 00000100:00100000:3.0:1789024281.949860:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409088:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 169us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024281.949868:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 147 00000100:00100000:3.0:1789024281.956668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024281.956705:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409216 00000100:00100000:3.0:1789024281.956714:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409216 00000100:00100000:3.0:1789024281.956756:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 148 00000100:00100000:3.0:1789024281.956765:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409216:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024281.956906:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409216:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 142us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024281.956914:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 148 00000100:00100000:1.0:1789024281.971029:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024281.971246:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409344 00000100:00100000:1.0:1789024281.971258:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409344 00000100:00100000:1.0:1789024281.971308:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00100000:1.0:1789024281.971318:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409344:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024281.971448:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409344:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024281.971463:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 149 00000100:00100000:1.0:1789024281.980702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024281.981011:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409472 00000100:00100000:3.0:1789024281.981022:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409472 00000100:00100000:3.0:1789024281.981078:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:3.0:1789024281.981088:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+12:14902:x1875927402409472:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024281.981104:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024281.981133:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb4cd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af939 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.981186:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb4cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af939 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.981199:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160600/0xa736ef4b98cb4cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af939 expref: 13 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024281.981209:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160600, rc 0) 00000100:00100000:0.0:1789024281.981682:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc10787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:14902:x1875927402409472:12345-192.168.202.18@tcp:101:ll_cfg_requeue.0 Request processed in 592us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024281.981692:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 150 00000100:00100000:1.0:1789024281.987958:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024281.988031:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409600 00000100:00100000:3.0:1789024281.988053:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409600 00000100:00100000:3.0:1789024281.988106:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00100000:3.0:1789024281.988124:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:14902:x1875927402409600:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024281.988302:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:14902:x1875927402409600:12345-192.168.202.18@tcp:501:ll_cfg_requeue.0 Request processed in 186us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024281.988309:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 151 00000100:00100000:1.0:1789024281.992347:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024281.992417:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409728 00000100:00100000:3.0:1789024281.992427:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409728 00000100:00100000:3.0:1789024281.992485:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 152 00000100:00100000:3.0:1789024281.992495:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:14902:x1875927402409728:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024281.992641:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:14902:x1875927402409728:12345-192.168.202.18@tcp:503:ll_cfg_requeue.0 Request processed in 147us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024281.992650:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 152 00010000:00010000:2.0:1789024282.124361:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789024282.188523:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789024282.188532:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc0706e000 from 13 10000000:01000000:1.0:1789024282.188538:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789024282.188590:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024282.188602:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024282.188613:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024282.188640:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789024282.188712:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024282.188813:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.189028:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411520 00000100:00100000:3.0:1789024282.189037:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411520 00000100:00100000:3.0:1789024282.189139:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789024282.189188:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+20:17140:x1875927422411520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024282.189203:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024282.189217:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160000/0xa736ef4b98cb4ce0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4cd9 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.189239:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160000/0xa736ef4b98cb4ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4cd9 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.189249:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160000/0xa736ef4b98cb4ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4cd9 expref: 21 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.189273:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160000, rc 0) 00000100:00100000:3.0:1789024282.189317:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.189324:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789024282.189402:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789024282.189418:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ce0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024282.189426:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4ce0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024282.189519:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789024282.189554:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024282.189809:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.189835:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411648 00000100:00100000:3.0:1789024282.189839:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411648 00000100:00100000:3.0:1789024282.189857:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789024282.189862:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.189975:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.189982:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789024282.190012:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.190041:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.190077:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024282.190091:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043900 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.190101:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411776 00000100:00100000:3.0:1789024282.190105:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411776 00000100:00100000:3.0:1789024282.190135:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789024282.190141:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.190240:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.190247:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789024282.190287:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789024282.191302:0:20249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789024282.191755:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789024282.191778:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789024282.191789:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ce0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.191800:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc00030c00/0xa736ef4b98cb4cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4ce0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789024282.191810:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789024282.191812:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cc30c2a800 from 13 10000000:01000000:2.0:1789024282.191821:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789024282.191850:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.191858:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.191868:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024282.191889:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.191998:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.192078:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08780 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.192726:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422411904 00000100:00100000:3.0:1789024282.192889:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422411904 00000100:00100000:3.0:1789024282.193037:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789024282.193047:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+21:17140:x1875927422411904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024282.193061:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024282.193076:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4cee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4ce7 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.193100:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4ce7 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.193110:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a161c00/0xa736ef4b98cb4cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4ce7 expref: 22 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.193239:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161c00, rc 0) 00000100:00100000:3.0:1789024282.193333:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422411904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.193340:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789024282.193532:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422411904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024282.193550:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cee expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.193558:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4cee expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024282.193619:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.193647:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.193720:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08780 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.193751:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412032 00000100:00100000:3.0:1789024282.193756:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412032 00000100:00100000:3.0:1789024282.193787:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789024282.193794:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422412032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.193899:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422412032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.193906:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789024282.194275:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.194301:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.194342:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.194360:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08780 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.194440:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412160 00000100:00100000:3.0:1789024282.194445:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412160 00000100:00100000:3.0:1789024282.194561:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789024282.194569:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422412160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.194660:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422412160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.194667:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789024282.194730:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789024282.196690:0:20250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789024282.197089:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789024282.197111:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024282.197439:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cee expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.197452:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc22fa5a00/0xa736ef4b98cb4ce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cee expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024282.197464:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789024282.197532:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb03356800 from 13 10000000:01000000:3.0:1789024282.197536:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789024282.197576:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.197584:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.197596:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024282.197621:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.197685:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024282.197772:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043600 going to sleep for 11 seconds 00000100:00100000:0.0:1789024282.197815:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412288 00000100:00100000:0.0:1789024282.197823:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412288 00000100:00100000:0.0:1789024282.197906:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789024282.197916:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+22:17140:x1875927422412288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789024282.197930:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024282.197953:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cb0252ee00/0xa736ef4b98cb4cfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4cf5 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024282.197976:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cb0252ee00/0xa736ef4b98cb4cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4cf5 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024282.197987:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cb0252ee00/0xa736ef4b98cb4cfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4cf5 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024282.197995:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ee00, rc 0) 00000100:00100000:0.0:1789024282.198044:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024282.198051:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789024282.198170:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024282.198185:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cfc expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.198194:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4cfc expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024282.198249:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.198275:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.198633:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08480 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.198694:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412416 00000100:00100000:3.0:1789024282.198699:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412416 00000100:00100000:3.0:1789024282.198724:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789024282.198731:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.198897:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.198903:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789024282.199059:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.199090:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.199167:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.199189:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08480 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.199293:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412544 00000100:00100000:3.0:1789024282.199298:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412544 00000100:00100000:3.0:1789024282.199329:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789024282.199336:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.199421:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.199428:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789024282.199601:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789024282.200703:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789024282.200880:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789024282.200903:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024282.200913:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cfc expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.200925:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a160200/0xa736ef4b98cb4cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4cfc expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789024282.201005:0:17140:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789024282.201009:0:17140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90cb0401f000 from 13 10000000:01000000:3.0:1789024282.201012:0:17140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789024282.201044:0:17140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.201050:0:17140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.201059:0:17140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024282.201096:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.201402:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.201488:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc02d24e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789024282.201610:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412672 00000100:00100000:1.0:1789024282.201618:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412672 00000100:00100000:3.0:1789024282.201749:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789024282.201761:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+23:17140:x1875927422412672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789024282.201774:0:17137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024282.201787:0:17137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb4d0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa736ef4b98cb4d03 expref: -99 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.201809:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb4d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa736ef4b98cb4d03 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.201819:0:17137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90cc1a160800/0xa736ef4b98cb4d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa736ef4b98cb4d03 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.201827:0:17137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160800, rc 0) 00000100:00100000:3.0:1789024282.201874:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422412672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.201881:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789024282.201970:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789024282.201984:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4d0a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024282.201993:0:17140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa736ef4b98cb4d0a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024282.202052:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.202077:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.202102:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08240 going to sleep for 11 seconds 00000100:00100000:3.0:1789024282.202264:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412800 00000100:00100000:3.0:1789024282.202269:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412800 00000100:00100000:3.0:1789024282.202296:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789024282.202302:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422412800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789024282.202401:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422412800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.202408:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789024282.202603:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.202630:0:17140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789024282.202668:0:17140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024282.202731:0:17140:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc03f08240 going to sleep for 11 seconds 00000100:00100000:0.0:1789024282.202818:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422412928 00000100:00100000:0.0:1789024282.202824:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422412928 00000100:00100000:1.0:1789024282.202870:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789024282.202879:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422412928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789024282.203009:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:17140:x1875927422412928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024282.203016:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789024282.203444:0:17140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc199bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:17140:1875927422412928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789024282.204635:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789024282.205045:0:17140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789024282.205069:0:17140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.118@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789024282.205086:0:17140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4d0a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024282.205097:0:17140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.118@tcp lock: ffff90cc1a161800/0xa736ef4b98cb4d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa736ef4b98cb4d0a expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024282.647618:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024282.647724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024282.647759:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024282.647777:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410240 00000100:00100000:0.0:1789024282.647787:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410240 00000100:00100000:0.0:1789024282.647867:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:0.0:1789024282.647878:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410240:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024282.647944:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410240:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024282.647951:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00080000:1.0:1789024282.648251:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789024282.656540:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024282.656573:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024282.656591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024282.656602:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410752 00000100:00100000:1.0:1789024282.656613:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410752 00000100:00100000:1.0:1789024282.656677:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:1.0:1789024282.656686:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc04bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410752:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024282.656752:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc04bde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410752:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024282.656758:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00080000:1.0:1789024282.656896:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024282.656940:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409984 00000100:00100000:3.0:1789024282.656945:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409984 00000100:00080000:1.0:1789024282.656982:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024282.656989:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410496 00000100:00100000:3.0:1789024282.656992:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410496 00000100:00100000:3.0:1789024282.657016:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00080000:1.0:1789024282.657020:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024282.657022:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:2403:x1875927402409984:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024282.657049:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:2403:x1875927402409984:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 28us (9443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.657053:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:3.0:1789024282.657062:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:3.0:1789024282.657067:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2403:x1875927402410496:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:3.0:1789024282.657087:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2403:x1875927402410496:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 20us (9328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024282.657093:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:2.0:1789024282.658241:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024282.658269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024282.658297:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410368 00000100:00100000:1.0:1789024282.658305:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410368 00000100:00100000:1.0:1789024282.658352:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:1.0:1789024282.658361:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410368:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:1.0:1789024282.658441:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410368:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024282.658480:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00080000:1.0:1789024282.658508:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024282.658602:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410112 00000100:00100000:0.0:1789024282.658607:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410112 00000100:00100000:0.0:1789024282.658667:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410624 00000100:00100000:0.0:1789024282.658670:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410624 00000100:00080000:1.0:1789024282.658951:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024282.659303:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:0.0:1789024282.659312:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410112:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024282.659359:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402410112:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 48us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024282.659367:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:2.0:1789024282.659373:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024282.659391:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:0.0:1789024282.659401:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410624:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024282.659408:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402410880 00000100:00100000:2.0:1789024282.659413:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402410880 00000100:00100000:0.0:1789024282.659448:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410624:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 48us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024282.659455:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:0.0:1789024282.659680:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402409856 00000100:00100000:0.0:1789024282.659686:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402409856 00000100:00100000:0.0:1789024282.659763:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 165 00000100:00100000:0.0:1789024282.659771:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2403:x1875927402409856:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024282.659807:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2403:x1875927402409856:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 37us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024282.659813:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 165 00000100:00100000:2.0:1789024282.661121:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:2.0:1789024282.661132:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410880:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024282.661184:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402410880:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 55us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024282.661190:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00080000:1.0:1789024282.662378:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024283.020460:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024283.020482:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422413184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024283.020545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024283.020593:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413184 00000100:00100000:3.0:1789024283.020600:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413184 00000100:00100000:3.0:1789024283.020649:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789024283.020658:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422413184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789024283.020698:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024283.020737:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422413184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024283.020743:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789024283.020784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422413184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789024283.021658:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422413056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024283.021700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789024283.021749:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024283.022023:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413056 00000100:00100000:3.0:1789024283.022030:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413056 00000100:00100000:3.0:1789024283.022085:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789024283.022093:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422413056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789024283.022119:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789024283.022199:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422413056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024283.022206:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789024283.022300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422413056:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789024283.022457:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789024283.148424:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789024283.814082:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024283.814221:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411008 00000100:00100000:0.0:1789024283.814232:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411008 00000100:00100000:0.0:1789024283.814296:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:0.0:1789024283.814308:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+6:15573:x1875927402411008:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789024283.814336:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024283.814362:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af940 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814432:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814447:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814459:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814473:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814480:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814487:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814603:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4d26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814611:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814626:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024283.814659:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789024283.814662:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024283.814700:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814711:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814717:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814725:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814731:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.814735:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814742:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814752:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:0.0:1789024283.814760:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.814766:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814772:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814785:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814791:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814796:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814800:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.814802:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814807:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814812:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90cc1888f700) 00010000:00010000:0.0:1789024283.814814:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.814817:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814822:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814851:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af940 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814875:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f600/0xa736ef4b98cb4d26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af940 expref: 7 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.814882:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cc1888fe00) 00010000:00010000:0.0:1789024283.814884:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024283.814887:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f600, rc 0) 00000100:00100000:0.0:1789024283.814955:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+7:15573:x1875927402411008:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 649us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024283.814962:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:2.0:1789024283.819306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024283.819511:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411136 00000100:00100000:3.0:1789024283.819523:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411136 00000100:00100000:3.0:1789024283.819622:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:3.0:1789024283.819633:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:371c06c4-35f7-46de-af51-de5f740e641b+7:15573:x1875927402411136:12345-192.168.202.18@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789024283.819759:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:371c06c4-35f7-46de-af51-de5f740e641b+7:15573:x1875927402411136:12345-192.168.202.18@tcp:900:lhsmtool_posix.0 Request processed in 127us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024283.819766:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:2.0:1789024283.835333:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024283.835434:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411392 00000100:00100000:0.0:1789024283.835444:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411392 00000100:00100000:0.0:1789024283.835832:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:0.0:1789024283.835844:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+7:15573:x1875927402411392:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789024283.835866:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024283.835887:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af947 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.835962:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.835976:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.835987:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.836046:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.836067:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.836074:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837000:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4d42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837011:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837019:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4d42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024283.837030:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789024283.837662:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837672:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837680:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837687:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.837692:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837699:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837723:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90cc1888fe00) 00010000:00010000:0.0:1789024283.837727:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.837732:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837739:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837755:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837788:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837794:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837799:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.837802:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837807:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837815:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90cc1888f700) 00010000:00010000:0.0:1789024283.837817:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.837820:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.837826:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.839533:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af947 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.839559:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252f800/0xa736ef4b98cb4d42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af947 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.839569:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc1888f900) 00010000:00010000:0.0:1789024283.839572:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.839576:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252f800, rc 0) 00000100:00100000:0.0:1789024283.839868:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+9:15573:x1875927402411392:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 4025us (4543us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789024283.840355:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:1.0:1789024283.848893:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024283.849247:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411520 00000100:00100000:0.0:1789024283.849260:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411520 00000100:00100000:0.0:1789024283.849324:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:0.0:1789024283.849335:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+9:15573:x1875927402411520:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789024283.849450:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+9:15573:x1875927402411520:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 116us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024283.849457:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024283.858378:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024283.858535:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411648 00000100:00100000:0.0:1789024283.858546:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411648 00000100:00100000:0.0:1789024283.858618:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:0.0:1789024283.858628:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+5:15573:x1875927402411648:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789024283.859873:0:17145:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1203us 00000100:00100000:2.0:1789024283.878760:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024283.879105:0:17144:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789024283.879115:0:17144:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789024283.879601:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411776 00000100:00100000:3.0:1789024283.879611:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411776 00000100:00100000:0.0:1789024283.879881:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:0.0:1789024283.879893:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+9:15579:x1875927402411776:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:0.0:1789024283.879916:0:20284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024283.879936:0:20284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af94e expref: -99 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.879996:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880010:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880022:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880037:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880044:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880050:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880108:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880116:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880122:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880138:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252fe00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.880143:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880382:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880395:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:0.0:1789024283.880398:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.880403:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880409:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252fe00/0xa736ef4b98cb4d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880421:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880426:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880432:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880437:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0252e200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024283.880440:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880445:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880462:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc1888f700) 00010000:00010000:0.0:1789024283.880464:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.880467:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880472:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252e200/0xa736ef4b98cb4d5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880505:0:20284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af94e expref: 10 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880516:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:0.0:1789024283.880518:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024283.880521:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0252ea00/0xa736ef4b98cb4d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af94e expref: 10 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.880530:0:20284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0252ea00, rc 0) 00000100:00100000:0.0:1789024283.880645:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+9:15579:x1875927402411776:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 754us (1893us total) trans 0 rc 301/301 00000100:00100000:0.0:1789024283.880652:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:2.0:1789024283.889727:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc199bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+5:15573:x1875927402411648:12345-192.168.202.18@tcp:59:lhsmtool_posix.0 Request processed in 31088us (31349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024283.889742:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:0.0:1789024283.894632:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024283.895078:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402411904 00000100:00100000:3.0:1789024283.895107:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402411904 00000100:00100000:3.0:1789024283.895199:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:3.0:1789024283.895211:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:371c06c4-35f7-46de-af51-de5f740e641b+9:15579:x1875927402411904:12345-192.168.202.18@tcp:700:lfs.0 00000100:00100000:3.0:1789024283.895492:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:371c06c4-35f7-46de-af51-de5f740e641b+9:15579:x1875927402411904:12345-192.168.202.18@tcp:700:lfs.0 Request processed in 282us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024283.895500:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:3.0:1789024283.906828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024283.907552:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412160 00000100:00100000:1.0:1789024283.907563:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412160 00000100:00100000:1.0:1789024283.907625:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:1.0:1789024283.907636:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+9:15579:x1875927402412160:12345-192.168.202.18@tcp:36:lfs.0 00010000:00010000:1.0:1789024283.907693:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024283.907724:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4c7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af8bb expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024283.907743:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:1.0:1789024283.907748:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024283.907806:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024283.907821:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024283.907829:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024283.907879:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024283.907893:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 5 pid: 17145 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024283.907908:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422413312:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024283.907996:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789024283.916340:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024283.916764:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422413312:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024283.916794:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024283.917316:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412288 00000100:00100000:0.0:1789024283.917325:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412288 00010000:00010000:0.0:1789024283.917368:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 6 pid: 17145 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024283.917415:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 15 00000100:00100000:0.0:1789024283.917426:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2403:x1875927402412288:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024283.917466:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024283.917475:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 6 pid: 17145 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917488:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 6 pid: 17145 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917509:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4cbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af92b expref: 6 pid: 17145 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917524:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:0.0:1789024283.917529:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917539:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917547:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024283.917578:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024283.917641:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402412288:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 217us (7497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024283.917649:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 15 00010000:00010000:2.0:1789024283.918291:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.918302:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.918332:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.918342:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.918352:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789024283.922186:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789024283.924381:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924402:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924414:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024283.924440:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1628942 reply state 0000000009d8ed4b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924463:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924472:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:2.0:1789024283.924475:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024283.924479:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789024283.924485:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789024283.924494:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924501:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924508:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924514:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024283.924520:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924526:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924534:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cb0231e300) 00010000:00010000:2.0:1789024283.924536:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024283.924539:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924556:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4d65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789024283.924576:0:17144:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1628942 reply state 0000000009d8ed4b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924584:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024283.924590:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc41bc6a00) 00010000:00010000:2.0:1789024283.924592:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789024283.924594:0:17144:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789024283.924691:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+10:15579:x1875927402412160:12345-192.168.202.18@tcp:36:lfs.0 Request processed in 17053us (17872us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789024283.924699:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:2.0:1789024284.006414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024284.006492:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412416 00000100:00100000:0.0:1789024284.006503:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412416 00000100:00100000:0.0:1789024284.006706:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:0.0:1789024284.006717:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+10:15587:x1875927402412416:12345-192.168.202.18@tcp:101:lctl.0 00010000:00010000:0.0:1789024284.006758:0:20284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789024284.006783:0:20284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4d7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af955 expref: -99 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.006854:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb4d81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.006870:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.006884:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024284.006940:0:20284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789024284.006944:0:20284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789024284.006982:0:20284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb4d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.007009:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4d7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af955 expref: 12 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.007029:0:20284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338a400/0xa736ef4b98cb4d81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af955 expref: 11 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.007038:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:0.0:1789024284.007041:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789024284.007045:0:20284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338a400, rc 0) 00000100:00100000:0.0:1789024284.007387:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+11:15587:x1875927402412416:12345-192.168.202.18@tcp:101:lctl.0 Request processed in 671us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024284.007395:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00080000:1.0:1789024284.007997:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024284.036333:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.036436:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412544 00000100:00100000:2.0:1789024284.036446:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412544 00000100:00100000:2.0:1789024284.036534:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00100000:2.0:1789024284.036557:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:15588:x1875927402412544:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024284.036577:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.036598:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af95c expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036666:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5c00/0xa736ef4b98cb4d8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036680:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5c00/0xa736ef4b98cb4d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036708:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5c00/0xa736ef4b98cb4d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.036753:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789024284.036758:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024284.036779:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5c00/0xa736ef4b98cb4d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036803:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af95c expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036823:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5c00/0xa736ef4b98cb4d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af95c expref: 6 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.036831:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:2.0:1789024284.036834:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024284.036838:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5c00, rc 0) 00000100:00100000:2.0:1789024284.036900:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15588:x1875927402412544:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 348us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.036907:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 30 00000100:00080000:1.0:1789024284.036985:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789024284.043065:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024284.044394:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789024284.044420:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422413440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789024284.044481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.045246:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413440 00000100:00100000:3.0:1789024284.045257:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413440 00000100:00100000:3.0:1789024284.045332:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789024284.045343:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422413440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789024284.045378:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789024284.045443:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875927422413440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.045451:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789024284.045477:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875927422413440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789024284.047708:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412672 00000100:00100000:2.0:1789024284.047722:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412672 00000100:00100000:2.0:1789024284.047799:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:2.0:1789024284.047810:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:15588:x1875927402412672:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024284.047832:0:20284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.047854:0:20284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af963 expref: -99 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047940:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047955:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047967:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047979:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047986:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.047993:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048067:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048076:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048083:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.048131:0:20284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789024284.048135:0:20284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024284.048167:0:20284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048190:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048196:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048203:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048209:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.048214:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048222:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024284.048232:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789024284.048235:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:2.0:1789024284.048239:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.048244:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024284.048248:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422413568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789024284.048255:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048270:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048276:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048282:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048294:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.048298:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048304:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024284.048312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789024284.048315:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc41bc6a00) 00010000:00010000:2.0:1789024284.048320:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.048323:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048328:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4da4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048354:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af963 expref: 8 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048369:0:20284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af963 expref: 7 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.048376:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:2.0:1789024284.048378:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789024284.048380:0:20284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:0.0:1789024284.048437:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413568 00000100:00100000:0.0:1789024284.048442:0:17149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413568 00000100:00100000:2.0:1789024284.048446:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+7:15588:x1875927402412672:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 637us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.048455:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 31 00000100:00100000:0.0:1789024284.048482:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789024284.048487:0:17149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422413568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789024284.048505:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789024284.048540:0:17149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875927422413568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024284.048544:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789024284.049727:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875927422413568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789024284.050409:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024284.050518:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402412800 00000100:00100000:0.0:1789024284.050525:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402412800 00000100:00100000:0.0:1789024284.050618:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:0.0:1789024284.050625:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:15588:x1875927402412800:12345-192.168.202.18@tcp:900:lfs.0 00000100:00100000:0.0:1789024284.050688:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:15588:x1875927402412800:12345-192.168.202.18@tcp:900:lfs.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024284.050693:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00080000:1.0:1789024284.050986:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789024284.053264:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.053359:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402413056 00000100:00100000:2.0:1789024284.053370:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402413056 00000100:00100000:2.0:1789024284.053423:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 32 00000100:00100000:2.0:1789024284.053431:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+7:15588:x1875927402413056:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024284.053450:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.053478:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af96a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.053566:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789024284.053653:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4db2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af96a expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.053664:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:2.0:1789024284.053666:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024284.053669:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af96a expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.053680:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4800, rc 0) 00000100:00100000:2.0:1789024284.053732:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+8:15588:x1875927402413056:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 301us (476us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789024284.053739:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 32 00000100:00100000:2.0:1789024284.055946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.056015:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402413312 00000100:00100000:3.0:1789024284.056023:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402413312 00000100:00100000:3.0:1789024284.056069:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:3.0:1789024284.056076:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+8:15588:x1875927402413312:12345-192.168.202.18@tcp:36:lfs.0 00010000:00010000:3.0:1789024284.056132:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024284.056172:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4dab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af963 expref: 8 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.056208:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:3.0:1789024284.056213:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789024284.056230:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.056241:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.056251:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789024284.056731:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9ec6dc3 reply state 000000006f86b705 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.056748:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.056754:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:3.0:1789024284.056757:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789024284.056760:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789024284.056769:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789024284.056859:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+9:15588:x1875927402413312:12345-192.168.202.18@tcp:36:lfs.0 Request processed in 782us (922us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789024284.056865:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 33 00000100:00100000:0.0:1789024284.061747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.061909:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402413568 00000100:00100000:3.0:1789024284.061919:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402413568 00000100:00100000:3.0:1789024284.061966:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:3.0:1789024284.061973:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+9:15588:x1875927402413568:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024284.062382:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb03a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+10:15588:x1875927402413568:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 407us (642us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789024284.062403:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:0.0:1789024284.066052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.066332:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402413824 00000100:00100000:2.0:1789024284.066343:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402413824 00000100:00100000:2.0:1789024284.066477:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:2.0:1789024284.066487:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+10:15588:x1875927402413824:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:2.0:1789024284.066513:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.066547:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af971 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066625:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066640:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066651:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066661:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066667:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066673:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.066773:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789024284.066842:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.066850:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067075:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067083:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.067087:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067559:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067574:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:2.0:1789024284.067577:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.067582:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067587:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067601:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067608:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067614:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067620:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.067623:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067629:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067635:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc41bc6a00) 00010000:00010000:2.0:1789024284.067638:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.067641:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067657:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4dd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067697:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4dc7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af971 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067706:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:2.0:1789024284.067709:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024284.067713:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af971 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.067722:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4800, rc 0) 00000100:00100000:2.0:1789024284.067840:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+11:15588:x1875927402413824:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 1353us (1797us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789024284.067848:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 34 00000100:00100000:1.0:1789024284.071424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.071584:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402413952 00000100:00100000:3.0:1789024284.071595:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402413952 00000100:00100000:3.0:1789024284.071679:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:3.0:1789024284.071690:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+11:15588:x1875927402413952:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024284.071720:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024284.071740:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4de3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af978 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071835:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071849:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071875:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.071901:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024284.071905:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024284.071924:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071952:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4de3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071971:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.071999:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:3.0:1789024284.072002:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789024284.072006:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160c00, rc 0) 00000100:00100000:3.0:1789024284.072067:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+12:15588:x1875927402413952:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 379us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.072074:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 35 00000100:00100000:0.0:1789024284.077694:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.077854:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414080 00000100:00100000:2.0:1789024284.077865:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414080 00000100:00100000:2.0:1789024284.077948:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:2.0:1789024284.077960:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+12:15588:x1875927402414080:12345-192.168.202.18@tcp:37:lfs.0 00000100:00100000:2.0:1789024284.083637:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+12:15588:x1875927402414080:12345-192.168.202.18@tcp:37:lfs.0 Request processed in 5669us (5942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.083650:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 3 00000100:00100000:1.0:1789024284.087627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.087805:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414336 00000100:00100000:3.0:1789024284.087815:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414336 00000100:00100000:3.0:1789024284.087916:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:3.0:1789024284.087927:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3469e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+12:15588:x1875927402414336:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024284.088190:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3469e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+13:15588:x1875927402414336:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 264us (571us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789024284.088197:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 4 00000100:00100000:0.0:1789024284.135319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.135495:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414464 00000100:00100000:3.0:1789024284.135509:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414464 00000100:00100000:3.0:1789024284.135576:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:3.0:1789024284.135587:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+11:15594:x1875927402414464:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024284.135606:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024284.135627:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4df1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af97f expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135689:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135704:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135733:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135745:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135752:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135758:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135836:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4e06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135845:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135851:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.135888:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789024284.135892:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024284.135935:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135947:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135954:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135970:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135976:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024284.135980:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135988:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.135999:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:3.0:1789024284.136002:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024284.136007:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136014:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4df8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136027:0:17143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136032:0:17143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136038:0:17143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136043:0:17143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024284.136046:0:17143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136059:0:17143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136066:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc41bc6a00) 00010000:00010000:3.0:1789024284.136068:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024284.136071:0:17143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136076:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4dff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136111:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af97f expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136124:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161e00/0xa736ef4b98cb4e06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af97f expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.136130:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:3.0:1789024284.136132:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789024284.136135:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161e00, rc 0) 00000100:00100000:3.0:1789024284.136249:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+12:15594:x1875927402414464:12345-192.168.202.18@tcp:101:bash.0 Request processed in 664us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.136256:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 36 00000100:00100000:0.0:1789024284.142677:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.142947:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414592 00000100:00100000:2.0:1789024284.142959:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414592 00000100:00100000:2.0:1789024284.143091:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:2.0:1789024284.143113:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:371c06c4-35f7-46de-af51-de5f740e641b+5:15594:x1875927402414592:12345-192.168.202.18@tcp:900:bash.0 00000100:00100000:2.0:1789024284.143229:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:371c06c4-35f7-46de-af51-de5f740e641b+5:15594:x1875927402414592:12345-192.168.202.18@tcp:900:bash.0 Request processed in 120us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.143236:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00080000:1.0:1789024284.144959:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789024284.146804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.146992:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414848 00000100:00100000:2.0:1789024284.147002:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414848 00000100:00100000:2.0:1789024284.147061:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:2.0:1789024284.147071:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+12:15594:x1875927402414848:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:2.0:1789024284.147093:0:20284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.147129:0:20284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4e0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af986 expref: -99 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.147589:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.147605:0:20284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.147614:0:20284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.147648:0:20284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.147661:0:20284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 12 pid: 17145 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024284.147674:0:20284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20284:1875927422413696:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024284.147820:0:20284:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043900 going to sleep for 11 seconds 00000100:00100000:0.0:1789024284.154410:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.154549:0:20284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20284:1875927422413696:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024284.154581:0:20284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024284.154669:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402414976 00000100:00100000:1.0:1789024284.154678:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402414976 00010000:00010000:1.0:1789024284.154722:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 13 pid: 17145 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024284.154762:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 16 00000100:00100000:1.0:1789024284.154772:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+13:2402:x1875927402414976:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024284.154805:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024284.154813:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 13 pid: 17145 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154826:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 13 pid: 17145 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154847:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4dea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af978 expref: 13 pid: 17145 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154864:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:1.0:1789024284.154869:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154878:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154885:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.154950:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024284.155010:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a8dfb3b-d145-43b9-83c6-a1d231848389+12:2402:x1875927402414976:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 239us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.155018:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 16 00010000:00010000:0.0:1789024284.157409:0:20284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.157425:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.157516:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.157813:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.157831:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159677:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159764:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159777:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789024284.159790:0:20284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789024284.159818:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159825:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159833:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159853:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:0.0:1789024284.159857:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.159990:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160005:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:0.0:1789024284.160008:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789024284.160013:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160019:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4e14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789024284.160034:0:20284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000979695a4 reply state 000000006719684e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160044:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160051:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90cc1888f100) 00010000:00010000:0.0:1789024284.160053:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789024284.160056:0:20284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789024284.160092:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4e0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 15 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160123:0:20284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 14 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024284.160141:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:0.0:1789024284.160143:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789024284.160176:0:20284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cb0338b200, rc 0) 00000100:00100000:0.0:1789024284.160433:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+15:15594:x1875927402414848:12345-192.168.202.18@tcp:101:bash.0 Request processed in 13362us (13636us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789024284.160443:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 37 00000100:00100000:0.0:1789024284.176578:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.177178:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402415104 00000100:00100000:3.0:1789024284.177189:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402415104 00000100:00100000:3.0:1789024284.177256:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 38 00000100:00100000:3.0:1789024284.177266:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+15:15594:x1875927402415104:12345-192.168.202.18@tcp:101:bash.0 00010000:00010000:3.0:1789024284.177309:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024284.177329:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af98d expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177395:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177409:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177421:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.177487:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789024284.177492:0:17143:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024284.177510:0:17143:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177521:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177545:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177564:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 16 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.177573:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.177576:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024284.177579:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161400, rc 0) 00000100:00100000:3.0:1789024284.177656:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3f9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+16:15594:x1875927402415104:12345-192.168.202.18@tcp:101:bash.0 Request processed in 391us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.177663:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 38 00010000:00010000:1.0:1789024284.180761:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024284.183252:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.183512:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402415360 00000100:00100000:3.0:1789024284.183524:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402415360 00000100:00100000:3.0:1789024284.183577:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:3.0:1789024284.183588:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+16:15594:x1875927402415360:12345-192.168.202.18@tcp:35:bash.0 00000100:00100000:3.0:1789024284.184072:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+17:15594:x1875927402415360:12345-192.168.202.18@tcp:35:bash.0 Request processed in 485us (829us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789024284.184080:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 5 00000100:00100000:0.0:1789024284.300645:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.305200:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402415616 00000100:00100000:3.0:1789024284.305215:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402415616 00000100:00100000:3.0:1789024284.305296:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:3.0:1789024284.305308:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+17:15604:x1875927402415616:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024284.305339:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024284.305365:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af994 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.305525:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789024284.305651:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af994 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.305665:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90cc1888f700) 00010000:00010000:3.0:1789024284.305668:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789024284.305673:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af994 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.305708:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161200, rc 0) 00000100:00100000:3.0:1789024284.305796:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+18:15604:x1875927402415616:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 491us (5160us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789024284.305803:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 39 00000100:00100000:0.0:1789024284.313356:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.313439:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402415872 00000100:00100000:3.0:1789024284.313456:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402415872 00000100:00100000:3.0:1789024284.313508:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:3.0:1789024284.313519:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+18:15604:x1875927402415872:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:3.0:1789024284.313713:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+19:15604:x1875927402415872:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 196us (367us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789024284.313718:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 6 00000100:00100000:1.0:1789024284.351516:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.352230:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402416128 00000100:00100000:3.0:1789024284.352241:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402416128 00000100:00100000:3.0:1789024284.352309:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:3.0:1789024284.352320:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+19:15607:x1875927402416128:12345-192.168.202.18@tcp:101:lfs.0 00010000:00010000:3.0:1789024284.352344:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024284.352363:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af99b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.352467:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4e53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.352481:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.352492:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4e53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.352515:0:17143:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789024284.352631:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4e4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af99b expref: 22 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.352650:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4e53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af99b expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.352660:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.352663:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024284.352667:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a161000, rc 0) 00000100:00100000:3.0:1789024284.352880:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+21:15607:x1875927402416128:12345-192.168.202.18@tcp:101:lfs.0 Request processed in 563us (1374us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789024284.352888:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 40 00000100:00100000:3.0:1789024284.366251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.366303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.366415:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402416256 00000100:00100000:1.0:1789024284.366415:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402416384 00000100:00100000:2.0:1789024284.366425:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402416256 00000100:00100000:1.0:1789024284.366425:0:17130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402416384 00000100:00100000:2.0:1789024284.366484:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:1.0:1789024284.366484:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:2.0:1789024284.366493:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+22:15607:x1875927402416256:12345-192.168.202.18@tcp:54:lfs.0 00000100:00100000:1.0:1789024284.366504:0:17130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:371c06c4-35f7-46de-af51-de5f740e641b+22:2403:x1875927402416384:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024284.366519:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024284.366546:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.366549:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4e53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af99b expref: 22 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.366561:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.366571:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.375087:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.375112:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024284.375217:0:17130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:371c06c4-35f7-46de-af51-de5f740e641b+21:2403:x1875927402416384:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 8707us (8907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.375595:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00010000:00010000:2.0:1789024284.382345:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383288:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383297:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383302:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.383306:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383333:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383347:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:2.0:1789024284.383349:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024284.383353:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.383357:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024284.383474:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+20:15607:x1875927402416256:12345-192.168.202.18@tcp:54:lfs.0 Request processed in 16977us (17227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.383485:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 41 00000100:00100000:3.0:1789024284.389648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.389735:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402416640 00000100:00100000:2.0:1789024284.389747:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402416640 00000100:00100000:2.0:1789024284.389810:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:2.0:1789024284.389822:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+20:15607:x1875927402416640:12345-192.168.202.18@tcp:35:lfs.0 00000100:00100000:2.0:1789024284.390069:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+21:15607:x1875927402416640:12345-192.168.202.18@tcp:35:lfs.0 Request processed in 249us (429us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789024284.390076:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 7 00000100:00100000:3.0:1789024284.556405:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422413952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789024284.556585:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024284.556681:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413952 00000100:00100000:2.0:1789024284.556690:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413952 00000100:00100000:2.0:1789024284.556756:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789024284.556766:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422413952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789024284.556794:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789024284.556839:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422413952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.556860:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789024284.556924:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422413952:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789024284.556950:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024284.556975:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789024284.556986:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024284.557013:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024284.557081:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422413824 00000100:00100000:1.0:1789024284.557085:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422413824 00000100:00100000:1.0:1789024284.557140:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789024284.557165:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422413824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789024284.557176:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789024284.557211:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422413824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.557217:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789024284.557248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb03a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789024284.557437:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422414464:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.557506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422414976:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557532:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.557552:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789024284.557558:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422414080:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.557621:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422414592:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557643:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.557658:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422415104:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789024284.557700:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414080 00000100:00100000:3.0:1789024284.557704:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414080 00000100:00100000:3.0:1789024284.557733:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789024284.557739:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422414080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557774:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68+24:3641:x1875927422414080:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.557780:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1789024284.557804:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789024284.557819:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5cc9fac3-ff77-40ec-8f57-b6a206d9fd68:3641:1875927422414080:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557839:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414976 00000100:00100000:3.0:1789024284.557843:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414976 00000100:00100000:3.0:1789024284.557871:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414592 00000100:00100000:3.0:1789024284.557873:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414592 00000100:00100000:3.0:1789024284.557882:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422415104 00000100:00100000:3.0:1789024284.557884:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422415104 00000100:00100000:3.0:1789024284.557897:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789024284.557902:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422414976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.557936:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875927422414976:12345-0@lo:400:kworker.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.557949:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789024284.557973:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789024284.557979:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422414592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.558007:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875927422414592:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.558013:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789024284.558024:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789024284.558030:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422415104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.558056:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875927422415104:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.558061:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789024284.558076:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024284.558078:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024284.558102:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875927422414592:0@lo:400:kworker.0 00010000:00080000:3.0:1789024284.558115:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae8a80 x1875927422415104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789024284.558125:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875927422415104:0@lo:400:kworker.0 00000100:00100000:3.0:1789024284.558134:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875927422414976:0@lo:400:kworker.0 00000100:00100000:2.0:1789024284.558354:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414464 00000100:00100000:2.0:1789024284.558358:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414464 00000100:00100000:2.0:1789024284.558391:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789024284.558397:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422414464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024284.558434:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875927422414464:12345-0@lo:400:kworker.0 Request processed in 38us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.558439:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789024284.558461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875927422414464:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558529:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422414208:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558554:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024284.558579:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422414720:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558605:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024284.558618:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789024284.558623:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422414336:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558649:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024284.558663:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024284.558695:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414720 00000100:00100000:1.0:1789024284.558698:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414720 00000100:00100000:1.0:1789024284.558719:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414336 00000100:00100000:1.0:1789024284.558721:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414336 00000100:00100000:1.0:1789024284.558730:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414848 00000100:00100000:1.0:1789024284.558732:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414848 00000100:00100000:1.0:1789024284.558744:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789024284.558749:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558776:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875927422414720:12345-0@lo:400:kworker.0 Request processed in 27us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.558782:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789024284.558792:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789024284.558796:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558815:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875927422414336:12345-0@lo:400:kworker.0 Request processed in 19us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.558820:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789024284.558828:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789024284.558833:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558850:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875927422414848:12345-0@lo:400:kworker.0 Request processed in 17us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.558855:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789024284.558873:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875927422414336:0@lo:400:kworker.0 00010000:00080000:1.0:1789024284.558883:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90cc3fae8e00 x1875927422414848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789024300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789024284.558897:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875927422414848:0@lo:400:kworker.0 00000100:00100000:1.0:1789024284.558906:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875927422414720:0@lo:400:kworker.0 00000100:00100000:2.0:1789024284.559061:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422414208 00000100:00100000:2.0:1789024284.559065:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422414208 00000100:00100000:2.0:1789024284.559103:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789024284.559110:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422414208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789024284.559143:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422414208:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.559175:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789024284.559195:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422414208:0@lo:400:kworker.0 00000100:00080000:3.0:1789024284.559685:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789024284.559690:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789024284.697397:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.697562:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402416896 00000100:00100000:1.0:1789024284.697572:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402416896 00000100:00100000:1.0:1789024284.697645:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:1.0:1789024284.697656:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+21:15638:x1875927402416896:12345-192.168.202.18@tcp:101:cat.0 00010000:00010000:1.0:1789024284.697680:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024284.697702:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9a2 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.697823:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.697838:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.697862:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789024284.697874:0:17144:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789024284.697999:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9a2 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.698021:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9a2 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.698030:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.698046:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789024284.698051:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030600, rc 0) 00000100:00100000:1.0:1789024284.698140:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+23:15638:x1875927402416896:12345-192.168.202.18@tcp:101:cat.0 Request processed in 486us (767us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789024284.698195:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 42 00000100:00100000:0.0:1789024284.700625:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.700768:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417152 00000100:00100000:3.0:1789024284.700778:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417152 00000100:00100000:3.0:1789024284.700826:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:3.0:1789024284.700835:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+23:15638:x1875927402417152:12345-192.168.202.18@tcp:35:cat.0 00000100:00100000:3.0:1789024284.706234:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3be9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+24:15638:x1875927402417152:12345-192.168.202.18@tcp:35:cat.0 Request processed in 5388us (5606us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789024284.706250:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 8 00000100:00100000:2.0:1789024284.706354:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.706410:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417280 00000100:00100000:1.0:1789024284.706419:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417280 00000100:00100000:1.0:1789024284.706486:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:1.0:1789024284.706497:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+24:2403:x1875927402417280:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024284.706512:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024284.706539:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9a2 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.706560:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.706566:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024284.706622:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+23:2403:x1875927402417280:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 127us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.706629:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:0.0:1789024284.759914:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.760066:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417536 00000100:00100000:2.0:1789024284.760077:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417536 00000100:00100000:2.0:1789024284.760190:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:2.0:1789024284.760200:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+23:15644:x1875927402417536:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:2.0:1789024284.760222:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.760241:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5600/0xa736ef4b98cb4e7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9a9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760358:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760373:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 24 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760382:0:17145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760389:0:17145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760422:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760435:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024284.760460:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875927422415232:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024284.760554:0:17145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 24 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.760564:0:17145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 24 pid: 20284 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024284.760572:0:17145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875927422415360:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024284.760603:0:17145:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024284.762876:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875927422415360:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024284.763973:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.764068:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417664 00000100:00100000:3.0:1789024284.764077:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417664 00010000:00010000:3.0:1789024284.764132:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 25 pid: 20284 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024284.764212:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:3.0:1789024284.764222:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+25:2403:x1875927402417664:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789024284.764242:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024284.764251:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 25 pid: 20284 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.764265:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 25 pid: 20284 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.764286:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338b200/0xa736ef4b98cb4e22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af986 expref: 25 pid: 20284 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.764302:0:17898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.764308:0:17898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.764317:0:17898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.764340:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024284.764388:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+24:2403:x1875927402417664:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 168us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.764395:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 17 00000100:00100000:2.0:1789024284.767327:0:17145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faea300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17145:1875927422415232:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024284.767360:0:17145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024284.768265:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.768342:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417792 00000100:00100000:1.0:1789024284.768350:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417792 00010000:00010000:1.0:1789024284.768386:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024284.768426:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 18 00000100:00100000:1.0:1789024284.768434:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb039ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+24:2403:x1875927402417792:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024284.768454:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024284.768462:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768489:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768511:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4e37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af98d expref: 24 pid: 17143 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768526:0:17129:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.768531:0:17129:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768541:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768548:0:17129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.768574:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024284.768624:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb039ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+23:2403:x1875927402417792:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 190us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.768631:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 18 00010000:00010000:3.0:1789024284.768778:0:17145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.768788:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024284.768805:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789024284.768966:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5600/0xa736ef4b98cb4e7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9a9 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.768982:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4600/0xa736ef4b98cb4e84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9a9 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.768990:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.768992:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789024284.768995:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4600, rc 0) 00000100:00100000:3.0:1789024284.769020:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+23:15644:x1875927402417536:12345-192.168.202.18@tcp:101:dd.0 Request processed in 8822us (9115us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789024284.769026:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 43 00000100:00100000:0.0:1789024284.772725:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.772801:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402417920 00000100:00100000:1.0:1789024284.772812:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402417920 00000100:00100000:1.0:1789024284.772884:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:1.0:1789024284.772894:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+23:15644:x1875927402417920:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:1.0:1789024284.772919:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024284.772938:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9b0 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.772990:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.773005:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.773016:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.773142:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4e92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 25 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.773201:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 24 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.773209:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.773212:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024284.773216:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00031200, rc 0) 00000100:00100000:1.0:1789024284.773268:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+24:15644:x1875927402417920:12345-192.168.202.18@tcp:101:dd.0 Request processed in 375us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.773275:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 44 00000100:00100000:0.0:1789024284.776469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.776624:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418176 00000100:00100000:3.0:1789024284.776634:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418176 00000100:00100000:3.0:1789024284.776694:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 45 00000100:00100000:3.0:1789024284.776705:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+24:15644:x1875927402418176:12345-192.168.202.18@tcp:36:dd.0 00010000:00010000:3.0:1789024284.776955:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.776969:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.776980:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789024284.777022:0:17143:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789024284.777045:0:17143:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008055ab93 reply state 00000000756f3cfd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.777057:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.777064:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.777067:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789024284.777071:0:17143:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789024284.777193:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fabb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418176:12345-192.168.202.18@tcp:36:dd.0 Request processed in 489us (733us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789024284.777200:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 45 00000020:00080000:3.0:1789024284.777205:0:17143:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789024284.779550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.779644:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418304 00000100:00100000:1.0:1789024284.779653:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418304 00000100:00100000:1.0:1789024284.779712:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:1.0:1789024284.779723:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418304:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:1.0:1789024284.779749:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024284.779771:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4ea7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9b7 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.779863:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b7 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.779879:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b7 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.779896:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.779899:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024284.779903:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030600, rc 0) 00000100:00100000:1.0:1789024284.779963:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+28:15644:x1875927402418304:12345-192.168.202.18@tcp:101:dd.0 Request processed in 241us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.779969:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 46 00000100:00100000:0.0:1789024284.792696:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.793037:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418560 00000100:00100000:3.0:1789024284.793050:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418560 00000100:00100000:3.0:1789024284.793139:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:3.0:1789024284.793190:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+28:15644:x1875927402418560:12345-192.168.202.18@tcp:103:dd.0 00010000:00010000:3.0:1789024284.793205:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789024284.793231:0:17898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4ea7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b7 expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.793266:0:17898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024284.793271:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789024284.793319:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418560:12345-192.168.202.18@tcp:103:dd.0 Request processed in 133us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.793327:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 2 00000100:00100000:0.0:1789024284.795614:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024284.795681:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418688 00000100:00100000:3.0:1789024284.795692:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418688 00000100:00100000:3.0:1789024284.795748:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:3.0:1789024284.795759:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418688:12345-192.168.202.18@tcp:58:dd.0 00010000:00010000:3.0:1789024284.795886:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.795904:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024284.795915:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024284.797062:0:17143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789024284.797495:0:17143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789024284.797848:0:17143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789024284.798082:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418688:12345-192.168.202.18@tcp:58:dd.0 Request processed in 2320us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024284.798112:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 47 00000100:00100000:0.0:1789024284.800712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.800823:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418816 00000100:00100000:1.0:1789024284.800834:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418816 00000100:00100000:1.0:1789024284.801007:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 48 00000100:00100000:1.0:1789024284.801019:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+27:15644:x1875927402418816:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:1.0:1789024284.801039:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024284.801062:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9be expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801131:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801142:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801277:0:17144:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801291:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801305:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024284.801308:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024284.801311:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 28 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024284.801319:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc00030800, rc 0) 00000100:00100000:1.0:1789024284.801376:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+28:15644:x1875927402418816:12345-192.168.202.18@tcp:101:dd.0 Request processed in 360us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.801382:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 48 00000040:00080000:0.0:1789024284.813007:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789024284.940417:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789024284.940427:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789024284.940454:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789024284.940464:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789024284.940597:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1875927422415488:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789024284.940706:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1789024284.946858:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17179:1875927422415488:192.168.202.18@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789024284.953905:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.954228:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402418944 00000100:00100000:2.0:1789024284.954238:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402418944 00000100:00100000:2.0:1789024284.954292:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:2.0:1789024284.954301:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+28:15645:x1875927402418944:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789024284.954331:0:17145:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789024284.954469:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+28:15645:x1875927402418944:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 168us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.954476:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 49 00000100:00100000:0.0:1789024284.962023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.962288:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402419072 00000100:00100000:2.0:1789024284.962300:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402419072 00000100:00100000:2.0:1789024284.962368:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:2.0:1789024284.962379:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+28:15645:x1875927402419072:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789024284.964201:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964226:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964239:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964354:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964363:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964370:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964396:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964404:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964410:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.964461:0:20284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789024284.964465:0:20284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789024284.964482:0:20284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964493:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964500:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964508:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964524:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4c00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.964528:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964536:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964547:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc1888f900) 00010000:00010000:2.0:1789024284.964550:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.964555:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964560:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4c00/0xa736ef4b98cb4ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964575:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964582:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964588:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964592:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.964595:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964600:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964616:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90cc41bc6f00) 00010000:00010000:2.0:1789024284.964619:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.964622:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964628:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4ec3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964642:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964647:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964722:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964729:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4000 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.964731:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964737:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964745:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:2.0:1789024284.964747:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789024284.964750:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.964756:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4000/0xa736ef4b98cb4eca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024284.964947:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+28:15645:x1875927402419072:12345-192.168.202.18@tcp:34:lhsmtool_posix.0 Request processed in 2566us (2929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024284.964956:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 50 00000100:00100000:0.0:1789024284.982747:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024284.985868:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402419328 00000100:00100000:2.0:1789024284.985884:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402419328 00000100:00100000:2.0:1789024284.986034:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:2.0:1789024284.986047:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+28:15645:x1875927402419328:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024284.986072:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024284.986112:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4ed1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9c5 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986278:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986298:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986314:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789024284.986326:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789024284.986424:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986432:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986450:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986478:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5800 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024284.986483:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986492:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986507:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:2.0:1789024284.986510:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789024284.986516:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986522:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5800/0xa736ef4b98cb4ed8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986569:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4ed1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9c5 expref: 30 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986581:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90cc1888f900) 00010000:00010000:2.0:1789024284.986583:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789024284.986588:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4ed1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9c5 expref: 30 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024284.986597:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:2.0:1789024284.986675:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+29:15645:x1875927402419328:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 631us (3938us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789024284.986682:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 51 00000100:00100000:0.0:1789024284.994744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024284.994917:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402419456 00000100:00100000:1.0:1789024284.994929:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402419456 00000100:00100000:1.0:1789024284.995006:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:1.0:1789024284.995016:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+29:15645:x1875927402419456:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789024284.995069:0:17144:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789024284.995239:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+29:15645:x1875927402419456:12345-192.168.202.18@tcp:53:lhsmtool_posix.0 Request processed in 224us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024284.995246:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 52 00000100:00100000:0.0:1789024285.003808:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.003918:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402419712 00000100:00100000:3.0:1789024285.003932:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402419712 00000100:00100000:3.0:1789024285.004017:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:3.0:1789024285.004028:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+29:15645:x1875927402419712:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024285.004058:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024285.004080:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4ee6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9cc expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789024285.004744:0:17143:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1789024285.004752:0:17143:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789024285.004772:0:17143:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789024285.004942:0:17143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4eed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.004956:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.004982:0:17143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4eed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.005040:0:17143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161000/0xa736ef4b98cb4ee6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9cc expref: 32 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.005057:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4eed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9cc expref: 31 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.005066:0:17143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb0231ee00) 00010000:00010000:3.0:1789024285.005069:0:17143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789024285.005072:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc1a160c00, rc 0) 00000100:00100000:3.0:1789024285.009663:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+31:15645:x1875927402419712:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 1118us (1346us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789024285.009691:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 53 00000100:00100000:0.0:1789024285.010106:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.010339:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402419968 00000100:00100000:1.0:1789024285.010349:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402419968 00000100:00100000:1.0:1789024285.010401:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:1.0:1789024285.010412:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+31:15645:x1875927402419968:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024285.010485:0:20284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024285.010513:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160c00/0xa736ef4b98cb4eed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9cc expref: 31 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010532:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb0231ee00) 00010000:00010000:1.0:1789024285.010544:0:20284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024285.010572:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010587:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010597:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010612:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010620:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010647:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010700:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010708:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010716:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010722:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc00030600 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.010727:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010735:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010742:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:1.0:1789024285.010746:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.010750:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010756:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030600/0xa736ef4b98cb4efb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010765:0:20284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010771:0:20284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010783:0:20284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010788:0:20284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.010791:0:20284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010798:0:20284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010806:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x54736b39 (ffff90cb032b2d00) 00010000:00010000:1.0:1789024285.010808:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.010811:0:20284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.010817:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f02 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x54736b39 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.010921:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+30:15645:x1875927402419968:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 510us (829us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789024285.010928:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 54 00000100:00100000:0.0:1789024285.013606:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.013829:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402420096 00000100:00100000:1.0:1789024285.013840:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402420096 00000100:00100000:1.0:1789024285.013907:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:1.0:1789024285.013917:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+30:15645:x1875927402420096:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024285.013937:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024285.013959:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f09 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9d3 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014013:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb4f10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014025:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb4f10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014037:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb4f10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014170:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9d3 expref: 32 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014189:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323600/0xa736ef4b98cb4f10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9d3 expref: 31 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.014198:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.014201:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789024285.014204:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323600, rc 0) 00000100:00100000:1.0:1789024285.014252:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+31:15645:x1875927402420096:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 336us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024285.014258:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 55 00000100:00100000:3.0:1789024285.020372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.020623:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402420352 00000100:00100000:1.0:1789024285.020633:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402420352 00000100:00100000:1.0:1789024285.020699:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:1.0:1789024285.020709:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+31:15645:x1875927402420352:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024285.020791:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.020820:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.020830:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789024285.021271:0:20284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789024285.021283:0:20284:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 603057135981ns, next at 604057132655ns, rc = 0 00000004:00010000:1.0:1789024285.021334:0:20284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055519e9e reply state 00000000b5edab2a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.021348:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.021356:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.021359:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789024285.021363:0:20284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024285.021546:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+33:15645:x1875927402420352:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 837us (1182us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789024285.021554:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 56 00000100:00100000:0.0:1789024285.029365:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.029477:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402420480 00000100:00100000:1.0:1789024285.029489:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402420480 00000100:00100000:1.0:1789024285.029557:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:1.0:1789024285.029569:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+33:15645:x1875927402420480:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789024285.029594:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789024285.029615:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9da expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.029701:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.029717:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 34 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.029735:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.029738:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789024285.029743:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc01323800, rc 0) 00000100:00100000:1.0:1789024285.029807:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+34:15645:x1875927402420480:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 241us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024285.029813:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 57 00000100:00100000:2.0:1789024285.032436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.032659:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402420608 00000100:00100000:1.0:1789024285.032669:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402420608 00000100:00100000:1.0:1789024285.032741:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00100000:1.0:1789024285.032751:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402420608:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789024285.032995:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+6:2403:x1875927402420608:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 245us (567us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789024285.033002:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 23 00000100:00080000:3.0:1789024285.033309:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789024285.036791:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.036880:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402420864 00000100:00100000:3.0:1789024285.036890:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402420864 00000100:00100000:3.0:1789024285.036951:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:3.0:1789024285.036973:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+34:15645:x1875927402420864:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789024285.037240:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+35:15645:x1875927402420864:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 280us (458us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789024285.037249:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 9 00000100:00100000:0.0:1789024285.039915:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.040073:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421120 00000100:00100000:2.0:1789024285.040085:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421120 00000100:00100000:2.0:1789024285.040194:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:2.0:1789024285.040205:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+35:15645:x1875927402421120:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789024285.040338:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+35:15645:x1875927402421120:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 135us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.040345:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 58 00000100:00100000:1.0:1789024285.043637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.043733:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421248 00000100:00100000:3.0:1789024285.043743:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421248 00000100:00100000:3.0:1789024285.043807:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:3.0:1789024285.043817:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+35:15645:x1875927402421248:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789024285.043839:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024285.043871:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f25 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9e1 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.043941:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.043959:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.043972:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789024285.044031:0:17144:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789024285.044054:0:17144:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.044124:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f25 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e1 expref: 37 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.044416:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e1 expref: 36 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.044429:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:3.0:1789024285.044432:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789024285.044436:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc342bc000, rc 0) 00000100:00100000:2.0:1789024285.044668:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+36:15645:x1875927402421248:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 851us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.044676:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 59 00000100:00100000:3.0:1789024285.047517:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.047662:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421376 00000100:00100000:2.0:1789024285.047673:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421376 00000100:00100000:2.0:1789024285.047727:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:2.0:1789024285.047737:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+6:2402:x1875927402421376:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024285.047754:0:19173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024285.047777:0:19173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9e8 expref: -99 pid: 19173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789024285.047803:0:19173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2581d, blocks: 0x0 00010000:00010000:2.0:1789024285.047823:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1789024285.047828:0:19173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024285.047836:0:19173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 7 pid: 19173 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.047854:0:19173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 7 pid: 19173 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.047886:0:19173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa5200, rc 0) 00000100:00100000:2.0:1789024285.047948:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+7:2402:x1875927402421376:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 212us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.047955:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 24 00000100:00100000:0.0:1789024285.051017:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.051399:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421632 00000100:00100000:2.0:1789024285.051412:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421632 00000100:00100000:2.0:1789024285.051492:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:2.0:1789024285.051504:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+36:15645:x1875927402421632:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789024285.051993:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bf8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:371c06c4-35f7-46de-af51-de5f740e641b+36:15645:x1875927402421632:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 489us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.052001:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 60 00000100:00100000:3.0:1789024285.054945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024285.055060:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421760 00000100:00100000:0.0:1789024285.055072:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421760 00000100:00100000:0.0:1789024285.055205:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:0.0:1789024285.055215:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+36:15645:x1875927402421760:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789024285.061721:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789024285.061743:0:17123:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789024285.061832:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061853:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061883:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061892:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.061897:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061908:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061931:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90cc41bc6a00) 00010000:00010000:1.0:1789024285.061935:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.061943:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.061951:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4400/0xa736ef4b98cb4d6c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024285.062002:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789024285.062026:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cb038abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422415616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789024285.062130:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789024285.062250:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422415616 00000100:00100000:0.0:1789024285.062264:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422415616 00000100:00100000:0.0:1789024285.062340:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789024285.062352:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875927422415616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789024285.062564:0:18651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789024285.062570:0:18651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789024285.062573:0:18651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789024285.062575:0:18651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789024285 -> 1789024285 00002000:00010000:0.0:1789024285.062579:0:18651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789024285.062669:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875927422415616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 319us (539us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789024285.062679:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1789024285.062875:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90cb038abb80/2, rc 0, transno 8589934596 00000100:00100000:3.0:1789024285.062886:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cb038abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875927422415616:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1789024285.063034:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1789024285.064306:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064327:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064336:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064343:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.064349:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064385:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064406:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:1.0:1789024285.064409:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.064416:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064423:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5400/0xa736ef4b98cb4d73 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064461:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064469:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064476:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064482:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.064485:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064492:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064500:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90cc1888f100) 00010000:00010000:1.0:1789024285.064503:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.064506:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064521:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cb0338aa00/0xa736ef4b98cb4e1b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064545:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064553:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064559:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064564:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.064567:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064572:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064581:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:1.0:1789024285.064583:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789024285.064587:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064593:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161200/0xa736ef4b98cb4ea0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064605:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064611:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064624:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064629:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:1.0:1789024285.064632:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064639:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064647:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.064650:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789024285.064653:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.064659:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f17 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065574:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065591:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065599:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065606:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a160a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:2.0:1789024285.065611:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065638:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065656:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90cc41bc6100) 00010000:00010000:2.0:1789024285.065659:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789024285.065665:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.065671:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a160a00/0xa736ef4b98cb4dc0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.067009:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+15:15645:x1875927402421760:12345-192.168.202.18@tcp:44:lhsmtool_posix.0 Request processed in 11778us (12060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024285.067027:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 61 00000100:00100000:3.0:1789024285.070622:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.070765:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402421888 00000100:00100000:2.0:1789024285.070775:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402421888 00000100:00100000:2.0:1789024285.070838:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:2.0:1789024285.070849:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+7:2402:x1875927402421888:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789024285.070968:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+7:2402:x1875927402421888:12345-192.168.202.18@tcp:16:lhsmtool_posix.0 Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.070976:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:2.0:1789024285.074288:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.076467:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422144 00000100:00100000:1.0:1789024285.076486:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422144 00000100:00100000:1.0:1789024285.076556:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:1.0:1789024285.076565:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+15:15645:x1875927402422144:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789024285.076617:0:20284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024285.076644:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bc000/0xa736ef4b98cb4f2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e1 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.076665:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.076670:0:20284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789024285.076714:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.076729:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.076739:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789024285.076891:0:20284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce5a8ebd reply state 00000000eec0d935 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.076903:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322400/0xa736ef4b98cb4f3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.076910:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.076913:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789024285.076915:0:20284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789024285.077015:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+16:15645:x1875927402422144:12345-192.168.202.18@tcp:36:lhsmtool_posix.0 Request processed in 451us (2739us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789024285.077022:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:3.0:1789024285.080120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.080282:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422272 00000100:00100000:2.0:1789024285.080292:0:18653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422272 00000100:00100000:2.0:1789024285.080350:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:2.0:1789024285.080360:0:18653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+7:15645:x1875927402422272:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789024285.080379:0:18653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789024285.080408:0:18653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9ef expref: -99 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.080471:0:18653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 8 pid: 19173 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.080481:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024285.080486:0:18653:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789024285.080491:0:18653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.080526:0:18653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 8 pid: 19173 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.080540:0:18653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 8 pid: 19173 timeout: 703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.080554:0:18653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18653:1875927422415744:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024285.080642:0:18653:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043900 going to sleep for 11 seconds 00000100:00100000:3.0:1789024285.083601:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.084175:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422400 00000100:00100000:1.0:1789024285.084185:0:17129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422400 00010000:00010000:1.0:1789024285.084228:0:17129:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 9 pid: 19173 timeout: 703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.084270:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:1.0:1789024285.084280:0:17129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+9:2403:x1875927402422400:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024285.084295:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024285.084320:0:17129:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 9 pid: 19173 timeout: 703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.084352:0:17129:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 9 pid: 19173 timeout: 703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.084380:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024285.084397:0:17129:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024285.084405:0:17129:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.084416:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.084467:0:17129:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.084482:0:17129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17129:1875927422415872:192.168.202.18@tcp:105: 00000100:00100000:1.0:1789024285.084568:0:17129:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd480 going to sleep for 11 seconds 00010000:00010000:2.0:1789024285.085309:0:18653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125c89d6/0xa736ef4b98cb4f33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9e8 expref: 9 pid: 19173 timeout: 703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.085329:0:18653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18653:1875927422415744:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024285.085358:0:18653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.085399:0:18653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc22fa4000, rc 0) 00000100:00100000:2.0:1789024285.085454:0:18653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:371c06c4-35f7-46de-af51-de5f740e641b+8:15645:x1875927402422272:12345-192.168.202.18@tcp:101:lhsmtool_posix.0 Request processed in 5096us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.085463:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:3.0:1789024285.090435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.090917:0:17129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17129:1875927422415872:192.168.202.18@tcp:105: 00010000:00010000:1.0:1789024285.090943:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024285.090999:0:17129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:371c06c4-35f7-46de-af51-de5f740e641b+7:2403:x1875927402422400:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 6720us (7407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024285.091010:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 19 00000100:00100000:2.0:1789024285.091189:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422528 00000100:00100000:2.0:1789024285.091197:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422528 00000100:00100000:2.0:1789024285.091244:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:2.0:1789024285.091253:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+7:2403:x1875927402422528:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789024285.091422:0:19173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789024285.091426:0:19173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789024285 00002000:00010000:2.0:1789024285.091428:0:19173:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789024284 00002000:00010000:2.0:1789024285.091431:0:19173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789024285 -> 1789024285 00002000:00010000:2.0:1789024285.091433:0:19173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789024285.091472:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+8:2403:x1875927402422528:12345-192.168.202.18@tcp:2:lhsmtool_posix.0 Request processed in 219us (1049us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789024285.091479:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:3.0:1789024285.095173:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024285.095869:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422656 00000100:00100000:0.0:1789024285.095881:0:18651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422656 00000100:00100000:0.0:1789024285.095957:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:0.0:1789024285.095968:0:18651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+8:2400:x1875927402422656:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789024285.096016:0:18651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.096038:0:18651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.096047:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789024285.096052:0:18651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789024285.096057:0:18651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.096112:0:18651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.096126:0:18651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.096140:0:18651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18651:1875927422416000:192.168.202.18@tcp:104: 00000100:00100000:0.0:1789024285.096259:0:18651:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb020523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789024285.101289:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.101554:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402422784 00000100:00100000:1.0:1789024285.101565:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402422784 00010000:00010000:1.0:1789024285.101604:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.101668:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 20 00000100:00100000:1.0:1789024285.101678:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+9:2403:x1875927402422784:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789024285.101696:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789024285.101716:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.101730:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 9 pid: 18653 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.101753:0:17898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024285.101757:0:17898:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789024285.101763:0:17898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.101771:0:17898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.101791:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789024285.101847:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+9:2403:x1875927402422784:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 169us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024285.101853:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 20 00010000:00010000:0.0:1789024285.106454:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f6ee664/0xa736ef4b98cb4f41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9ef expref: 8 pid: 18653 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.106483:0:18651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc07484700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18651:1875927422416000:192.168.202.18@tcp:104: 00010000:00010000:0.0:1789024285.106529:0:18651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106542:0:18651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106550:0:18651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106583:0:18651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106590:0:18651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106598:0:18651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106606:0:18651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cb0338aa00 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:0.0:1789024285.106610:0:18651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106618:0:18651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106637:0:18651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.106654:0:18651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d7700a/0xa736ef4b98cb4f48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.106769:0:18651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cb038a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:371c06c4-35f7-46de-af51-de5f740e641b+7:2400:x1875927402422656:12345-192.168.202.18@tcp:1:lhsmtool_posix.0 Request processed in 10802us (11626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024285.106779:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 29 00000100:00100000:3.0:1789024285.111719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.111827:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423040 00000100:00100000:2.0:1789024285.111837:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423040 00000100:00100000:2.0:1789024285.111906:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:2.0:1789024285.111916:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+16:15645:x1875927402423040:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789024285.111998:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.112018:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.112042:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.112078:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.112107:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 16 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.112125:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416128:192.168.202.18@tcp:104: 00000100:00100000:2.0:1789024285.112250:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb02043900 going to sleep for 11 seconds 00000100:00100000:2.0:1789024285.115326:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3faeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416128:192.168.202.18@tcp:104: 00010000:00010000:2.0:1789024285.115357:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024285.116585:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.116900:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423168 00000100:00100000:2.0:1789024285.116910:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423168 00010000:00010000:2.0:1789024285.116948:0:17128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.116991:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 21 00000100:00100000:2.0:1789024285.117000:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:371c06c4-35f7-46de-af51-de5f740e641b+17:2403:x1875927402423168:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789024285.117015:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789024285.117022:0:17128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117064:0:17128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117098:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00031200/0xa736ef4b98cb4e99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9b0 expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117117:0:17128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:2.0:1789024285.117123:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117133:0:17128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117140:0:17128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117457:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.117491:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789024285.117551:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:371c06c4-35f7-46de-af51-de5f740e641b+16:2403:x1875927402423168:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 551us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.117558:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 21 00010000:00010000:1.0:1789024285.117612:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117620:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117823:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117836:0:17144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117843:0:17144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117874:0:17144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.117888:0:17144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 16 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.117900:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416256:192.168.202.18@tcp:104: 00000100:00100000:1.0:1789024285.117948:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc054cf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789024285.126975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:0.0:1789024285.127202:0:17898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423296 00000100:00100000:0.0:1789024285.127216:0:17898:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423296 00010000:00010000:0.0:1789024285.127264:0:17898:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.127309:0:17898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 22 00000100:00100000:0.0:1789024285.127321:0:17898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+17:2402:x1875927402423296:12345-192.168.202.18@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789024285.127340:0:17898:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789024285.127349:0:17898:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.127363:0:17898:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 17 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.127385:0:17898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:0.0:1789024285.127390:0:17898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.127400:0:17898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.127421:0:17898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789024285.127454:0:17898:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789024285.127509:0:17898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:371c06c4-35f7-46de-af51-de5f740e641b+17:2402:x1875927402423296:12345-192.168.202.18@tcp:103:ldlm_bl.0 Request processed in 191us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024285.127516:0:17898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 22 00010000:00010000:1.0:1789024285.127746:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01323800/0xa736ef4b98cb4f1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9da expref: 16 pid: 17144 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789024285.127764:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416256:192.168.202.18@tcp:104: 00010000:00010000:1.0:1789024285.127786:0:17144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.127795:0:17144:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.127801:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789024285.127925:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1789024285.128039:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789024285.128076:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1789024285.128191:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1875927422416384:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789024285.128232:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024285.128308:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc342b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789024285.130318:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422416384 00000100:00100000:2.0:1789024285.130335:0:17148:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422416384 00000100:00100000:2.0:1789024285.130411:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789024285.130421:0:17148:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17144:x1875927422416384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789024285.130732:0:17148:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17144:x1875927422416384:12345-0@lo:1000:mdt00_001.0 Request processed in 311us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024285.130739:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789024285.130833:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1875927422416384:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789024285.131019:0:17144:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789024285.131551:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1875927422416512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789024285.131607:0:17144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024285.131688:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cb033bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789024285.134709:0:18205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422416512 00000100:00100000:0.0:1789024285.134725:0:18205:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422416512 00000100:00100000:0.0:1789024285.134802:0:18205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789024285.134814:0:18205:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17144:x1875927422416512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789024285.135034:0:18205:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17144:x1875927422416512:12345-0@lo:1000:mdt00_001.0 Request processed in 222us (3425us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789024285.135054:0:18205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789024285.135249:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17144:1875927422416512:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789024285.135317:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135329:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135337:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135343:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322a00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024285.135349:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135357:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135373:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:3.0:1789024285.135376:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024285.135382:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135402:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc01322a00/0xa736ef4b98cb4f56 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135434:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135450:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135455:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135471:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc1a161400 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024285.135475:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135481:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135490:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024285.135492:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789024285.135500:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135512:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135522:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.135584:0:17144:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90cc00030800/0xa736ef4b98cb4eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9be expref: 19 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789024285.135597:0:17144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416640:192.168.202.18@tcp:105: 00000100:00100000:3.0:1789024285.135764:0:17144:0:(client.c:2716:ptlrpc_set_wait()) set ffff90cc192b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789024285.138023:0:17144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc34601880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17144:1875927422416640:192.168.202.18@tcp:105: 00010000:00010000:3.0:1789024285.138052:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138078:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc1a161400/0xa736ef4b98cb4eae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17143 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138125:0:17144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138139:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138169:0:17144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138180:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138186:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138192:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138198:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc342bdc00 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024285.138202:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138208:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138219:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024285.138222:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789024285.138225:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138236:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bdc00/0xa736ef4b98cb4f5d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138246:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138251:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138257:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138262:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa5200 already unused, calling callback (ffffffffc1a7d4f0) 00010000:00010000:3.0:1789024285.138265:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138270:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138277:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024285.138280:0:17144:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024285.138282:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.138288:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa5200/0xa736ef4b98cb4f4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17144 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789024285.139923:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789024285.139931:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789024285.139949:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789024285.139955:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789024285.143180:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:371c06c4-35f7-46de-af51-de5f740e641b+19:15645:x1875927402423040:12345-192.168.202.18@tcp:57:lhsmtool_posix.0 Request processed in 31253us (31459us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789024285.143197:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00000020:00080000:3.0:1789024285.143205:0:17144:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789024285.146894:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.150429:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423424 00000100:00100000:3.0:1789024285.150599:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423424 00000100:00100000:3.0:1789024285.150676:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:3.0:1789024285.150688:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3469f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+19:15644:x1875927402423424:12345-192.168.202.18@tcp:49:dd.0 00000100:00100000:3.0:1789024285.150973:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3469f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:371c06c4-35f7-46de-af51-de5f740e641b+19:15644:x1875927402423424:12345-192.168.202.18@tcp:49:dd.0 Request processed in 286us (4090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024285.150981:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 10 00000100:00100000:0.0:1789024285.151917:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024285.153881:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423680 00000100:00100000:2.0:1789024285.153893:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423680 00000100:00100000:2.0:1789024285.153997:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 11 00000100:00100000:2.0:1789024285.154008:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+19:15645:x1875927402423680:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789024285.154716:0:17146:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789024285.154748:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789024285.154786:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154802:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154813:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154822:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154828:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154834:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.154900:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789024285.155020:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:371c06c4-35f7-46de-af51-de5f740e641b+21:15645:x1875927402423680:12345-192.168.202.18@tcp:35:lhsmtool_posix.0 Request processed in 1012us (3163us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789024285.155057:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 11 00000020:00080000:2.0:1789024285.155062:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789024285.158568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.158747:0:20284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423808 00000100:00100000:3.0:1789024285.158757:0:20284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423808 00000100:00100000:3.0:1789024285.158810:0:20284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:3.0:1789024285.158819:0:20284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+21:15644:x1875927402423808:12345-192.168.202.18@tcp:101:dd.0 00010000:00010000:3.0:1789024285.158841:0:20284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789024285.158918:0:20284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bd800/0xa736ef4b98cb4f6b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa6cdd89e162af9f6 expref: -99 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.158954:0:20284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bde00/0xa736ef4b98cb4f72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.158968:0:20284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bde00/0xa736ef4b98cb4f72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.158979:0:20284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bde00/0xa736ef4b98cb4f72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.159254:0:20284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bd800/0xa736ef4b98cb4f6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9f6 expref: 23 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.159279:0:20284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90cc342bde00/0xa736ef4b98cb4f72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.18@tcp remote: 0xa6cdd89e162af9f6 expref: 22 pid: 20284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.159287:0:20284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90cc1888fc00) 00010000:00010000:3.0:1789024285.159291:0:20284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789024285.159294:0:20284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90cc342bde00, rc 0) 00000100:00100000:3.0:1789024285.159396:0:20284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:371c06c4-35f7-46de-af51-de5f740e641b+22:15644:x1875927402423808:12345-192.168.202.18@tcp:101:dd.0 Request processed in 578us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789024285.159404:0:20284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00010000:00010000:1.0:1789024285.159536:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789024285.159544:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.159552:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc22fa4800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:1.0:1789024285.159556:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.159565:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.159576:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90cb032b2b00) 00010000:00010000:1.0:1789024285.159578:0:17131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789024285.159582:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.159598:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90cc22fa4800/0xa736ef4b98cb4f64 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.159609:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024285.159611:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789024285.159612:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789024285.196451:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789024285.327880:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:1.0:1789024285.328001:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402423936 00000100:00100000:1.0:1789024285.328012:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402423936 00000100:00100000:1.0:1789024285.328103:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 0 00000100:00100000:1.0:1789024285.328114:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:371c06c4-35f7-46de-af51-de5f740e641b+7:2403:x1875927402423936:12345-192.168.202.18@tcp:4:dd.0 00002000:00010000:1.0:1789024285.328199:0:18657:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa2581d, atime: 0x6aa2581c, ctime: 0x6aa2581d, blocks: 0x0 00010000:00010000:1.0:1789024285.328209:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.328226:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=603s v=(0 0) 00010000:00010000:1.0:1789024285.328230:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789024285.328236:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789024285.328249:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789024285.329614:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:3.0:1789024285.329706:0:18659:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789024285.329716:0:18659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789024285.330028:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424064 00000100:00100000:0.0:1789024285.330036:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424064 00000100:00100000:3.0:1789024285.331013:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 1 00000100:00100000:3.0:1789024285.331028:0:20285:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc07485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:371c06c4-35f7-46de-af51-de5f740e641b+8:2402:x1875927402424064:12345-192.168.202.18@tcp:4:dd.0 00010000:00010000:3.0:1789024285.331760:0:20285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.331783:0:20285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024285.331787:0:20285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789024285.331794:0:20285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789024285.331810:0:20285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789024285.436012:0:19467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1789024285.436029:0:19467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1789024285.436311:0:20285:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1789024285.436317:0:20285:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1789024285.436335:0:20285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436350:0:20285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436359:0:20285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436861:0:20285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc342bd800 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024285.436867:0:20285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436875:0:20285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436908:0:20285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.436915:0:20285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004114025a/0xa736ef4b98cb4f80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.437012:0:20285:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:371c06c4-35f7-46de-af51-de5f740e641b+7:2402:x1875927402424064:12345-192.168.202.18@tcp:4:dd.0 Request processed in 105982us (107397us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789024285.437034:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 1 00000001:00080000:0.0:1789024285.460029:0:19467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789024285.464487:0:18657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1789024285.464513:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464526:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464536:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464543:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90cc01322000 already unused, calling callback (ffffffffc0e568b0) 00010000:00010000:2.0:1789024285.464548:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464556:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464576:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789024285.464584:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a7878ab/0xa736ef4b98cb4f79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789024285.464760:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc07487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402423936:12345-192.168.202.18@tcp:4:dd.0 Request processed in 136642us (136884us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789024285.464771:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 0 00010000:00010000:1.0:1789024286.220411:0:18299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789024287.038697:0:20323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789024287.249319:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789024287.769473:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769545:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769555:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769576:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.18@tcp (source: 12345-192.168.202.18@tcp) 00000100:00100000:2.0:1789024287.769600:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424192 00000100:00100000:2.0:1789024287.769608:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424192 00000100:00100000:2.0:1789024287.769649:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 167 00000100:00100000:2.0:1789024287.769657:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2403:x1875927402424192:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.769708:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3bd32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4577274-ebf6-4f7f-a31d-56fffdb0df46+13:2403:x1875927402424192:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.769715:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 167 00000100:00100000:2.0:1789024287.769747:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424448 00000100:00100000:2.0:1789024287.769751:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424448 00000100:00100000:2.0:1789024287.769779:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424960 00000100:00100000:2.0:1789024287.769782:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424960 00000100:00100000:2.0:1789024287.769792:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424320 00000100:00100000:2.0:1789024287.769793:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424320 00000100:00100000:2.0:1789024287.769799:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424832 00000100:00100000:2.0:1789024287.769800:0:17143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424832 00000100:00100000:2.0:1789024287.769808:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:2.0:1789024287.769812:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402424448:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.769833:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402424448:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.769848:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 62 00000100:00100000:2.0:1789024287.769861:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:2.0:1789024287.769867:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402424960:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.769892:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402424960:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.769897:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 63 00000100:00100000:2.0:1789024287.769908:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:2.0:1789024287.769913:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+22:2402:x1875927402424320:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.769938:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:371c06c4-35f7-46de-af51-de5f740e641b+22:2402:x1875927402424320:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.769945:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 64 00000100:00100000:2.0:1789024287.769957:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:2.0:1789024287.769962:0:17143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2402:x1875927402424832:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.769986:0:17143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a8dfb3b-d145-43b9-83c6-a1d231848389+6:2402:x1875927402424832:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.769991:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 65 00000100:00100000:2.0:1789024287.770008:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424704 00000100:00100000:2.0:1789024287.770012:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424704 00000100:00100000:2.0:1789024287.770031:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402425216 00000100:00100000:2.0:1789024287.770034:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402425216 00000100:00100000:2.0:1789024287.770042:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402424576 00000100:00100000:2.0:1789024287.770043:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402424576 00000100:00100000:2.0:1789024287.770049:0:19173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927402425088 00000100:00100000:2.0:1789024287.770050:0:19173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927402425088 00000100:00100000:2.0:1789024287.770057:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024287.770082:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402424704:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.770111:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+5:2403:x1875927402424704:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.770118:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 25 00000100:00100000:2.0:1789024287.770129:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:2.0:1789024287.770136:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402425216:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.770178:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2403:x1875927402425216:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 42us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.770184:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 26 00000100:00100000:2.0:1789024287.770194:0:19173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00100000:2.0:1789024287.770199:0:19173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+5:2402:x1875927402424576:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:2.0:1789024287.770219:0:19173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3fae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:371c06c4-35f7-46de-af51-de5f740e641b+5:2402:x1875927402424576:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 20us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789024287.770224:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:0.0:1789024287.770238:0:18654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2402:x1875927402425088:12345-192.168.202.18@tcp:400:kworker.0 00000100:00100000:0.0:1789024287.770272:0:18654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc3faea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a8dfb3b-d145-43b9-83c6-a1d231848389+5:2402:x1875927402425088:12345-192.168.202.18@tcp:400:kworker.0 Request processed in 42us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024287.770529:0:19173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 27 00000100:00080000:2.0:1789024287.770568:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789024287.770573:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789024287.770576:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789024287.770578:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789024287.773434:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.18@tcp, seq: 28 00000100:00100000:1.0:1789024288.140362:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789024288.140387:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422416768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789024288.140520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789024288.140680:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422416768 00000100:00100000:2.0:1789024288.140689:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422416768 00000100:00100000:2.0:1789024288.140752:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789024288.140763:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422416768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789024288.140793:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789024288.140842:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc107b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875927422416768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789024288.140858:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789024288.140907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc3fae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875927422416768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789024288.140963:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024288.141093:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789024288.141105:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422416896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789024288.141135:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789024288.141232:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927422416896 00000100:00100000:1.0:1789024288.141236:0:18656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927422416896 00000100:00100000:1.0:1789024288.141272:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789024288.141280:0:18656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90cc34601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422416896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789024288.141290:0:18656:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789024288.141318:0:18656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90cc34601880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875927422416896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789024288.141323:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789024288.141374:0:17139:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789024288.141398:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90cc107bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875927422416896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789024288.268354:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42158 lines, 42158 kept, 0 dropped, 0 bad.